Information recording medium, information recording device and method for reproducing audio information and still picture information simulataneously

ABSTRACT

An information recording medium has recorded thereon a plurality of sets of still image information to be continuously played back in the form called a slide show audio information to be played back in synchronization with the still image information. Also recorded on the information recording medium is playback control information for playing back the audio information in synchronization with the sets of still image information. When the still image information sets are sequentially played back, the audio information is played back in synchronization with the still image information according to the playback control information. The playback control information includes audio repeat information for controlling the repetition of the audio information. The repeated playback of the audio information is controlled according to the audio repeat information.

TECHNICAL FIELD

The present invention relates to a technical field of an informationrecord medium such as an a high density optical disc, capable ofrecording various kinds of information (e.g., main video, audio,sub-picture and reproduction control information) with high density, aninformation record apparatus and a method thereof for recording theinformation onto the information record medium, an informationreproduction apparatus and a method thereof for reproducing theinformation from the information record medium, an information recordreproduction apparatus and a method thereof capable of recording andreproducing the information, a computer program for record orreproduction control and a data structure including a control signal forthe reproduction control.

BACKGROUND TECHNIQUE

In a so-called “DVD audio standard”, a “browseable slide show” is used.The browseable slide show can output and display still pictures preparedin advance during reproduction of a piece of music, and can change thedisplayed still pictures in order by operation of a reproductionapparatus by a user.

The browseable slide show treats an audio as main contents, and candisplay the still pictures by using the reproduction clock of the audioas reference, only within a time period in which the audio exists.Namely, when no audio exists, the still pictures cannot be displayed.

DISCLOSURE OF INVENTION

The present invention has been achieved in order to solve the aboveproblems. It is an object of this invention to provide an informationrecord medium, an information record apparatus and a method thereof, aninformation reproduction apparatus and a method thereof, an informationrecord reproduction apparatus and a method thereof, an informationrecord program, an information reproduction program, an informationrecord reproduction program, and a data structure including a controlsignal for reproduction control, capable of reproducing an audio invarious kinds of manners together with the reproduction of stillpictures by using the information record medium including the stillpictures and the audio.

According to one aspect of the present invention, there is provided aninformation record medium including: still picture information whichincludes at least one still picture; audio information; reproductioncontrol information which reproduces the audio information insynchronization with reproduction of the still picture information,wherein the reproduction control information includes audio repeatinformation for controlling repeat reproduction of the audio informationsynchronized with the still picture information.

Onto the above information record medium, the still picture informationsuccessively reproduced in a manner called “slide show” and the audioinformation synchronized with the still picture information to bereproduced are recorded, for example. The reproduction controlinformation reproducing the audio information in synchronization withthe still picture information is further recorded thereon, too. When thestill picture information is reproduced, the audio informationsynchronized with the still picture information is reproduced inaccordance with the reproduction control information. The reproductioncontrol information includes the audio repeat information controllingthe repeat of the audio information, and the repeat reproduction of theaudio information is accordingly controlled.

The reproduction control information may include still picture repeatinformation for controlling the repeat reproduction of the still pictureinformation having at least one still picture. Thereby, the repeatreproduction of the still picture information can be controlled.

The reproduction control information may define reproduction timing ofthe audio information with respect to a reproduction time axis of thestill picture. Specifically, the reproduction control information may bedefined such that the audio information is reproduced only duringreproduction of the still picture. Thereby, the still picture can berepeatedly reproduced in the so-called slide show, and the audioinformation corresponding to BGM can be reproduced.

The audio repeat information may indicate whether or not the audioinformation is repeatedly reproduced. The still picture repeatinformation may indicate whether or not the still picture information isrepeatedly reproduced. Moreover, each piece of the still pictureinformation may be constructed by an item unit defining a reproductionsequence of still picture contents, and the still picture repeatinformation may include continuous information indicating whether or notsubsequent still picture information is to be reproduced as onereproduction sequence.

According to another aspect of the present invention, there is providedan information record apparatus including: a first record unit whichrecords still picture information including at least one still pictureand audio information; and a second record unit which recordsreproduction control information for reproducing the audio informationin synchronization with reproduction of the still picture information,wherein the second record unit records the reproduction controlinformation so that the reproduction control information includes audiorepeat information for controlling repeat reproduction of the audioinformation synchronized with the still picture information.

In addition, from the similar viewpoint, there is provided aninformation record method including: a first record process whichrecords still picture information including at least one still pictureand audio information; and a second record process which recordsreproduction control information for reproducing the audio informationin synchronization with reproduction of the still picture information,wherein the second record process records the reproduction controlinformation so that the reproduction control information includes audiorepeat information for controlling repeat reproduction of the audioinformation synchronized with the still picture information.

Further, from the similar viewpoint, there is provided an informationrecord program executed on a computer, making the computer function as:a first record unit which records still picture information including atleast one still picture and audio information; and a second record unitwhich records reproduction control information for reproducing the audioinformation in synchronization with reproduction of the still pictureinformation, wherein the second record unit records the reproductioncontrol information so that the reproduction control informationincludes audio repeat information for controlling repeat reproduction ofthe audio information synchronized with the still picture information.

In accordance with the above information record apparatus, theinformation record method and the information record program, the stillpicture information successively reproduced in the manner called “slideshow”, the audio information synchronized with the still pictureinformation to be reproduced and the reproduction control informationreproducing the audio information in synchronization with the stillpicture information are recorded onto the information record medium, forexample. Therefore, when the still picture information is reproduced,the audio information synchronized with the still picture information isreproduced in accordance with the reproduction control information. Thereproduction control information includes the audio repeat informationcontrolling the repeat of the audio information, and the repeatreproduction of the audio information is accordingly controlled.

According to still another aspect of the present invention, there isprovided an information reproduction apparatus which reproduces aninformation record medium including: still picture information whichincludes at least one still picture; audio information; reproductioncontrol information which reproduces the audio information insynchronization with reproduction of the still picture information, thereproduction control information including audio repeat information forcontrolling repeat reproduction of the audio information synchronizedwith the still picture information, the apparatus comprising: a readingunit which reads the still picture information, the audio informationand the reproduction control information from the information recordmedium; a still picture reproduction unit which reproduces the stillpicture information; and an audio reproduction unit which reproduces theaudio information in synchronization with reproduction of the stillpicture information in accordance with the audio repeat information inthe reproduction control information.

In addition, from the similar viewpoint, there is provided aninformation reproduction method which reproduces an information recordmedium including: still picture information which includes at least onestill picture; audio information; reproduction control information whichreproduces the audio information in synchronization with reproduction ofthe still picture information, the reproduction control informationincluding audio repeat information for controlling repeat reproductionof the audio information synchronized with the still pictureinformation, the method comprising: a reading process which reads thestill picture information, the audio information and the reproductioncontrol information from the information record medium; a still picturereproduction process which reproduces the still picture information; andan audio reproduction process which reproduces the audio information insynchronization with reproduction of the still picture information inaccordance with the audio repeat information in the reproduction controlinformation.

Further, from the similar viewpoint, there is provided a computerprogram product executed on a computer to reproduce an informationrecord medium including: still picture information including at leastone still picture; audio information; and reproduction controlinformation which reproduces the audio information in synchronizationwith reproduction of the still picture information, the reproductioncontrol information including audio repeat information for controllingrepeat reproduction of the audio information synchronized with the stillpicture information, the program makes the computer function as: areading unit which reads the still picture information, the audioinformation and the reproduction control information from theinformation record medium; a still picture reproduction unit whichreproduces the still picture information; and an audio reproduction unitwhich reproduces the audio information in synchronization withreproduction of the still picture information in accordance with theaudio repeat information in the reproduction control information.

In accordance with the above information reproduction apparatus, theabove information reproduction method and the above informationreproduction program, the still picture information including at leastone still picture successively reproduced in the manner called “slideshow”, the audio information synchronized with the still pictureinformation to be reproduced and the reproduction control informationfor reproducing the audio information in synchronization with the stillpicture information are recorded onto the information record medium whenthe still picture information is reproduced, the still pictureinformation, the audio information and the reproduction controlinformation are read from the information record medium, and the audioinformation synchronized with the still picture information isreproduced in accordance with the reproduction control information. Thereproduction control information includes the audio repeat informationcontrolling the repeat of the audio information, and the repeatreproduction of the audio information is accordingly controlled.

According to still another aspect of the present invention, there isprovided an information record reproduction apparatus including aninformation record unit and an information reproduction unit, whereinthe information record unit includes a first record unit which recordsstill picture information including at least one still picture and audioinformation and a second record unit which records reproduction controlinformation for reproducing the audio information in synchronizationwith reproduction of the still picture information, wherein the secondrecord unit records the reproduction control information so that thereproduction control information includes audio repeat information forcontrolling repeat reproduction of the audio information synchronizedwith the still picture information, and wherein the informationreproduction unit includes: a reading unit which reads the still pictureinformation, the audio information and the reproduction controlinformation from the information record medium; a still picturereproduction unit which reproduces the still picture information; and anaudio reproduction unit which reproduces the audio information insynchronization with reproduction of the still picture information inaccordance with the audio repeat information in the reproduction controlinformation.

Additionally, from the similar viewpoint, an information recordreproduction method may include an information record process and aninformation reproduction process, wherein the information record processincludes a first record process which records still picture informationincluding at least one still picture and audio information and a secondrecord process which records reproduction control information forreproducing the audio information in synchronization with reproductionof the still picture information, wherein the second record processrecords the reproduction control information so that the reproductioncontrol information includes audio repeat information for controllingrepeat reproduction of the audio information synchronized with the stillpicture information, and wherein the information reproduction processincludes: a reading process which reads the still picture information,the audio information and the reproduction control information from theinformation record medium; a still picture reproduction process whichreproduces the still picture information; and an audio reproductionprocess which reproduces the audio information in synchronization withreproduction of the still picture information in accordance with theaudio repeat information in the reproduction control information.

Further, from the similar viewpoint, there is provided an informationrecord reproduction program executed on a computer, making the computerfunction as an information record reproduction apparatus including aninformation record unit and an information reproduction unit, whereinthe information record unit includes a first record unit which recordsstill picture information including at least one still picture and audioinformation and a second record unit which records reproduction controlinformation for reproducing the audio information in synchronizationwith reproduction of the still picture information, wherein the secondrecord unit records the reproduction control information so that thereproduction control information includes audio repeat information forcontrolling repeat reproduction of the audio information synchronizedwith the still picture information, and wherein the informationreproduction unit includes: a reading unit which reads the still pictureinformation, the audio information and the reproduction controlinformation from the information record medium; a still picturereproduction unit which reproduces the still picture information; and anaudio reproduction unit which reproduces the audio information insynchronization with reproduction of the still picture information inaccordance with the audio repeat information in the reproduction controlinformation.

In accordance with the above information record reproduction apparatus,the above information record reproduction method and the aboveinformation record reproduction program, the still picture informationsuccessively reproduced in the manner called “slide show”, the audioinformation synchronized with the still picture information to bereproduced and the reproduction control information for reproducing theaudio information in synchronization with the still picture informationare recorded onto the record medium. In addition, when the still pictureinformation is reproduced, the still picture information, the audioinformation and the reproduction control information are read from theinformation record medium, and the audio information synchronized withthe still picture information is reproduced in accordance with thereproduction control information. The reproduction control informationincludes the audio repeat information controlling the repeat of theaudio information, and the repeat reproduction of the audio informationis accordingly controlled.

According to still another aspect of the present invention, there isprovided a data structure including still picture information includingat least one still picture, audio information and reproduction controlinformation for reproducing the audio information in synchronizationwith reproduction of the still picture information, wherein thereproduction control information includes audio repeat information forcontrolling repeat reproduction of the audio information synchronizedwith the still picture information.

In accordance with the data structure including the above controlsignal, when the still picture is reproduced in order in the mannercalled “slide show” and the audio information is reproduced insynchronization with it, it can be controlled whether or not to repeatthe audio information.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates a basic structure of an optical disc according to anembodiment of an information record medium according to the presentinvention, wherein its upper part illustrates a general plan view of theoptical disc having plural areas and its lower part illustrates aschematic conceptual diagram of an area structure in a radius directioncorresponding to the general plan view in the upper part.

FIG. 2A illustrates a schematic conceptual diagram of a conventionalprogram stream of MPEG2, FIG. 2B illustrates a schematic conceptualdiagram of a transport stream of MPEG2 used in the embodiment, and FIG.2C illustrates a schematic conceptual diagram of a program stream ofMPEG2 used in the embodiment.

FIG. 3 is a diagram schematically illustrating a data structure recordedonto the optical disc in the embodiment.

FIG. 4 is a conceptual view hierarchically illustrating a detailed datastructure in each title shown in FIG. 3.

FIG. 5 is a conceptual view hierarchically illustrating a detailed datastructure in each playlist set shown in FIG. 3.

FIG. 6 is a conceptual view schematically illustrating a detailed datastructure in each playlist set shown in FIG. 3.

FIG. 7 is a conceptual diaphragm schematically illustrating a detaileddata structure in each item shown in FIG. 6.

FIG. 8 is a conceptual diaphragm schematically illustrating a datalogical structure in each title element shown in FIG. 4.

FIG. 9 is a conceptual diaphragm schematically illustrating a datalogical structure in each title element shown in FIG. 4 in a case thateach playlist set is constructed by one playlist in this embodiment.

FIG. 10 is a conceptual view schematically illustrating a detailed datastructure in each object shown in FIG. 3.

FIG. 11 is a view conceptually illustrating a situation in theembodiment that an elementary stream for a program #1, shown in theupper column, and en elementary stream for a program #2, shown in themiddle column, are multiplexed to form a transport stream for these twoprograms, on the basis of a time scale in a horizontal direction.

FIG. 12 is a view conceptually illustrating an image of TS packetsmultiplexed in one transport stream in the embodiment, as a packetarrangement based on the time scale.

FIG. 13 is a view schematically illustrating a logical structure of dataon an optical disc in the embodiment, focusing on development from alogic hierarchy to an object hierarchy or an entity hierarchy.

FIG. 14 is a block diagram schematically illustrating an informationrecord reproduction apparatus according to the embodiment of the presentinvention.

FIG. 15 is a flow chart indicating a recording operation (part 1) of theinformation record reproduction apparatus in the embodiment.

FIG. 16 is a flow chart indicating a recording operation (part 2) of theinformation record reproduction apparatus in the embodiment.

FIG. 17 is a flow chart indicating a recording operation (part 3) of theinformation record reproduction apparatus in the embodiment.

FIG. 18 is a flow chart indicating a recording operation (part 4) of theinformation record reproduction apparatus in the embodiment.

FIG. 19 is a flow chart indicating a reproduction operation of theinformation record reproduction apparatus in the embodiment.

FIG. 20 is a view showing a reproduction example of a still picture andan audio in a case that a still picture repeat flag and an audio repeatflag are in an ON state in reproduction of a browseable slide showaccording to the embodiment.

FIG. 21 is a view showing a reproduction example of the still pictureand the audio in a case that the still picture repeat flag is in the ONstate and the audio repeat flag is in an OFF state in the reproductionof the browseable slide show according to the embodiment.

FIG. 22 is a view showing a reproduction example of the still pictureand the audio in a case that the still picture repeat flag is in the OFFstate and the audio repeat flag is in the ON state in the reproductionof the browseable slide show according to the embodiment.

FIG. 23 is a view showing a reproduction example of the still pictureand the audio in a case that the still picture repeat flag is in the OFFstate and the audio repeat flag is in the ON state in the reproductionof the browseable slide show according to the embodiment.

FIG. 24 is a view showing an example of a playlist information table forexecuting the browseable slide show according to the embodiment.

FIG. 25 shows a definitive example of the still picture to be reproducedin a case that time information is added to an object itself.

FIG. 26 shows a definitive example of the still picture to be reproducedin the case that the time information is added to the object itself.

FIG. 27 is a flow chart of a reproduction process including thereproduction of the browseable slide show according to the embodiment.

FIG. 28 is a flow chart of a sub-routine related to the reproduction ofthe browseable slide show shown in FIG. 27.

FIG. 29 is a view conceptually showing an entire flow of access at thetime of the reproduction in relation to the logical structure of theoptical disc in the embodiment.

FIG. 30 is a conceptual view schematically showing a hierarchicalstructure in a specific example of a title information set in theembodiment.

FIG. 31 is a conceptual view schematically showing a hierarchicalstructure in a specific example of a disc header in the embodiment.

FIG. 32 is a conceptual view schematically showing a hierarchicalstructure in a specific example of title information in the embodiment.

FIG. 33 is a conceptual view schematically showing a hierarchicalstructure in a specific example of the playlist set in the embodiment.

FIG. 34 is a conceptual view schematically showing a hierarchicalstructure in a specific example of the playlist in the embodiment.

FIG. 35 is a conceptual view schematically showing a hierarchicalstructure in a specific example of the playlist element in theembodiment.

FIG. 36 is a conceptual view schematically showing the hierarchicalstructure in a specific example of an item definition table in theembodiment.

FIG. 37 is a view schematically showing a specific example of a datastructure in an AU table constructed in an object information file andan ES map table related to the AU table in a specific example accordingto the embodiment.

FIG. 38 is a view schematically showing a specific example of the datastructure in the AU table constructed in the object information file andthe ES map table related to the AU table in specific example accordingto the embodiment.

FIG. 39 is a conceptual view schematically showing a hierarchicalstructure in a modification of the playlist.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

(Information Record Medium)

The information record medium of the present invention is discussed,with reference to its embodiments, as well as FIG. 1 to FIG. 13. Inthese embodiments, the information record medium of the presentinvention is applied to an optical disc capable of recording (writing)and reproducing (reading).

Firstly, with reference to FIG. 1, a fundamental structure of theoptical disc in an embodiment is discussed. FIG. 1 illustrates, in itsupper part, a general plan view of the optical disc structure having aplurality of areas, and illustrates conceptually, in its lower part, anarea structure in the radius direction corresponding to the upper part.

As shown in FIG. 1, the optical disc 100 may be recorded by variousrecord methods, such as a magneto-optical method, a phase change method,capable of recording (writing) only once or a plurality of times.Similarly to DVDs, the optical disc 100 has a lead-in area 104, a dataarea 106 and a lead-out area 108, from the inner circumference around acenter hole 102 to the outer circumference, on the record surface of thedisc body measuring about 12 cm in diameter. In each area, groove tracksand land tracks may be alternately arranged, concentrically or spirallyaround the center hole 102. The groove tracks may be wobbled.Furthermore, pre-pits may be formed on one or both of these tracks.Incidentally, the present invention is not exclusively limited to theoptical disc having three areas mentioned above.

Next, with reference to FIGS. 2A to 2C, the structures of the transportstream (TS) and the program stream (PS) to be recorded onto the opticaldisc in the embodiment are discussed. FIG. 2A schematically illustratesa MPEG2 program stream structure of a conventional DVD for comparison,FIG. 2B schematically illustrates a MPEG2 transport stream (TS)structure. Furthermore, FIG. 2C schematically illustrates a MPEG2program stream structure in the present invention.

In FIG. 2A, one program stream to be recorded in the conventional DVDincludes only one video stream for video data as main pictureinformation, along the time axis t, and further includes up to 8 audiostreams for audio data as audio information and up to 32 sub-picturestreams for sub-picture data as sub-picture information. That is, thevideo data to be multiplexed at an arbitrary time point tx relates toonly one video stream. For example, a plurality of video streamscorresponding to a plurality of TV programs or a plurality of moviescannot be included at the same time in the program stream. It is notpossible to multiplex a plurality of TV programs and transfer or recordthem, in a program stream format of a DVD having only one video stream,because at least one video stream is required for each TV program, inorder to transfer or record the multiplexed TV program or the likeinvolving a video image.

In FIG. 2B, one transport stream (TS) to be recorded in the optical disc100 of the present invention includes a plurality of video streams aselementary streams (ES) for video data as main picture information, andfurther includes a plurality of audio streams as elementary streams (ES)for audio data as audio information and a plurality of sub-picturestreams as elementary streams (ES) for sub-picture as sub-pictureinformation. That is, the video data to be multiplexed at an arbitrarytime point tx relates to a plurality of video streams. For example, aplurality of video streams that may correspond to a plurality of TVprograms or a plurality of movies can be included at the same time inthe transport stream. Thus, it is possible to multiplex a plurality ofTV programs and transfer or record them, in the transport stream formathaving a plurality of video streams. However, the sub-picture stream isnot transferred in a digital broadcasting employing the existingtransport stream.

In FIG. 2C, one program stream (PS) to be recorded onto the optical disc100 of the present invention includes a plurality of video streams forvideo data as main picture information, and further includes a pluralityof audio streams for audio data as audio information and a plurality ofsub-picture streams for sub-picture data as sub-picture information.That is, the video data to be multiplexed at an arbitrary time point txrelates to a plurality of video streams. For example, a plurality ofvideo streams that may correspond to a plurality of TV programs or aplurality of movies can be included at the same time in the programstream.

Incidentally, for convenience of explanation, the video stream, theaudio stream and the sub-picture stream are arranged in this order fromthe top in FIG. 2A to FIG. 2C. Nevertheless, this order or sequence doesnot correspond to an order or sequence for multiplexing packet by packetas mentioned below. In the transport stream, conceptually, a set of onevideo stream, two audio streams and two sub-picture streams correspondsto one program for example.

The optical disc 100 in the aforementioned embodiment is adapted tomulti-record the transport stream (TS) as shown in FIG. 2B, i.e. torecord a plurality of programs at the same time, within the restrictionof the record rate. Furthermore, instead of or in addition to thistransport stream, the program stream (PS) as shown in FIG. 2C can bemulti-recorded onto the same optical disc 100.

Next, with reference to FIG. 3 and FIG. 10, a structure of data to berecorded onto the optical disc 100 is discussed. FIG. 3 schematicallyillustrates the data structure to be recorded onto the optical disc 100.FIG. 4 schematically illustrates in detail the data structure in eachobject shown in FIG. 3. FIG. 5 and FIG. 6 schematically show a datastructure in detail respectively in each playlist (P list) set shown inFIG. 3. FIG. 7 schematically shows detail of the data structure of eachitem shown in FIG. 6. FIG. 8 schematically shows a logical structure ofdata in each title element shown in FIG. 4. FIG. 9 schematically shows alogical structure of data in each title element shown in FIG. 4, in acase that each playlist set is composed of one playlist. FIG. 10schematically shows a detail of a data structure in each object shown inFIG. 3.

In the following explanation, the “title” means a reproduction unit, onthe basis of which a plurality of “playlists” is executed successivelyor sequentially, and which is a logically large grouped unit, such asone movie or one TV program. The “playlist set” means a bundle of“playlists”. For example, it may be a bundle of playlists to reproduce aplurality of contents information having a special relationshipswitchable to each other in an angle reproduction or a parentalreproduction, or may be a bundle of playlists to reproduce contentsinformation relating to a plurality of programs broadcasted in the sametime zone and collectively recorded. Alternatively, it may be a bundleof playlists to reproduce various contents information, in one title,prepared on the basis of required function, for example on the basis ofvideo performance or audio performance required for the informationreproduction system, such as a high vision compatibility, a displayresolution, a surround speaker compatibility, a speaker layout and soon. The “playlist” is information for storing the information requiredto reproduce the “object” and consists of a plurality of “items” eachstoring the information about a reproduction range of the object toaccess the object. The “object” is the entity information of contentsconstructing the aforementioned MPEG2 transport stream.

In FIG. 3, the optical disc 100 is provided with four files as a logicalstructure; a disc information file 110; a playlist (P list) informationfile 120; an object information file 130; and an object data file 140.The disc 100 is further provided with a file system 105 for managingthese files. Incidentally, although FIG. 3 does not show directly thephysical data arrangement on the optical disc 100, it is possible toperform the recording in such a manner that the arrangement shown inFIG. 3 corresponds to another arrangement shown in FIG. 1. That is, itis possible to record the file system 105 or the like in the data recordarea 106 following the lead-in area 104 and further record the objectdata file 140 or the like in the data record area 106. The filestructure shown in FIG. 3 can be constructed, even without the lead-inarea 104 or the lead-out area 108 shown in FIG. 1.

The disc information file 110 is a file for storing general informationabout the entire optical disc 100, and stores the disc generalinformation 112, the title information table 114 and other information118. The disc general information 112 may store the total numbers oftitles or the like in the optical disc 100. The title information table114 includes a title pointer 114-1 and a plurality of titles 200 (title#1-#m) whose ID (identification) number or record address is indicatedby the title pointer. In each title 200, each title type (e.g.sequential reproduction type, branch type and so on), or the playlist (Plist) number constructing each title is stored for each title, as thelogical information.

More specifically, for example, as shown in FIG. 4, each title 200 ismade of a title general information 200-1, a plurality of title elements200-2 and other information 200-5. Furthermore, each title element 200-2is made of a pre-command 200PR, a pointer 200PT to a playlist set, apost command 200PS and other information 200-6.

The pointer 200PT as an example of the first pointer informationaccording to the present invention indicates an ID number of theplaylist set 126S stored in the playlist information file 120corresponding to contents information to be reproduced on the basis ofthe title element 200-2 including the pointer 200PT. Incidentally, thepointer 200PT may be information to indicate a record position of theplaylist set 126S corresponding to the contents information to bereproduced on the basis of the title element 200-2. The pre-command200PR as an example of the first pre-command according to the presentinvention indicates a command to be executed before reproducing thecontents information whose reproduction sequence is defined by oneplaylist set 126S designated by the pointer 200PT. The post command200PS as an example of the first post command according to the presentinvention is a command to be executed after reproducing the contentsinformation whose reproduction sequence is defined by said one playlistset. Other information 200-5 included in the title element 200-2 mayinclude next information to designate a title element for a nextreproduction after the present reproduction of the present titleelement, for example.

Therefore, when the information reproduction apparatus which will bedescribed later reproduces the information record medium, the desiredcontents information can be reproduced as a title element 200-2, bymaking access to the playlist set 126S in accordance with the pointer200PT and performing a control to select playlist corresponding to thedesired program or the like from among a plurality of playlists 126 inthe playlist set 126S. Furthermore, reproducing such a title element200-2 solely or sequentially makes it possible to reproduce one title200. Furthermore, it is possible to execute commands to be executedbefore reproduction, in the contents information whose reproductionsequence is defined by one playlist set 126S designated by the pointer200PT, according to the pre-command 200PR. Furthermore, it is possibleto execute commands to be executed after the reproduction, in thecontents information whose reproduction sequence is defined by oneplaylist set 126S designated by the pointer 200FT, according to the postcommand 200PS. The post command 200PS may be a command to branch thecontents information, a command to select a next title and so on.Additionally, it is possible to reproduce a next title element 200-2 tobe reproduced after the presently reproduced title element 200-2,according to the “next information” included in other information 200-5.

Again in FIG. 3, the playlist information file 120 stores the playlist(P list) information table 121 indicating the logical structure of eachplaylist. This table 121 is divided into the playlist (P list)management information 122, the playlist (P list) set pointer 124, aplurality of playlist (P list) sets 126S (P list set #1-#n), and otherinformation 128. In this playlist information table 121, the logicalinformation of each playlist set 126S is stored in the order of theplaylist set number. In other words, the order for storing the eachplaylist set 126S is the playlist set numbers. Furthermore, in the aforementioned title information table 114, the same playlist set 126Scan be referred from a plurality of titles 200. That is, the playlistset #p in the playlist set information table 121 may be pointed on thetitle information table 114, even in the case that title #q and title #ruse the same playlist set #p.

As shown in FIG. 5, the playlist set 126S includes playlist set generalinformation 126-1, a plurality of playlists 126 (playlist #1-#x), anitem definition table 126-3, and other information 126-4. Each playlist126 includes a plurality of playlist elements 126-2 (playlist element#1-#y), and other information 126-5. Furthermore, each playlist element126-2 includes a pre-command 126PR, a pointer 126PT to item, a postcommand 126PS and other information 126-6.

The pointer 126PT as an example of the second pointer informationaccording to the present invention indicates an item identificationnumber defined by the item definition table 126-3 corresponding to thecontents information to be reproduced on the basis of the playlistelement 126-2 including the pointer 126PT. Incidentally, the pointer126PT may be an item record position defined by the item definitiontable 126-3.

As shown in FIG. 6, in the playlist set 126S, a plurality of items 204is defined in the item definition table 126-3. They commonly belong to aplurality of playlists 126. Furthermore, as the playlist set generalinformation 126-1, a name of each playlist 126 included in the playlistset 126S, UI (user interface information) such as a reproduction time,address information to each item definition table 126-3 and so on arerecorded.

Again in FIG. 5, the pre-command 126PR as an example of the secondpre-command according to the present invention indicates a command to beexecuted before reproduction of one item 204 designated by the pointer126PT. The post command 126PS as an example of the second post commandaccording to the present invention indicates a command to be executedafter the reproduction of said one item 204. Other information 126-6included in the playlist element 126-2 may include the next informationto designate the playlist element 126-2 relating to the nextreproduction of the reproduction of the playlist element 126-2.

As shown in FIG. 7, the item 204 is a minimum unit to be displayed. Inthe item 204, “in-point information” to indicate a start address of anobject and “out-point information” to indicate an end address of theobject are recorded. Incidentally, each of these “in-point information”and “out-point information” may indicate the address directly orindirectly as a time period or time point on the reproduction timescale. In the figure, if a plurality of ES's (Elementary Streams) ismultiplexed for the object designated by “stream object #m”, designatingthe item 204 means designating a special ES or special combination ofES's.

As shown in FIG. 8, the title element 200-2 logically consists of thepre-command 200PR or 126PR, the playlist set 126S selected by thepointer 200PT, the post command 200PS or 126PS, and the next information200-6N. Therefore, a processing to select the playlist 126 from amongthe playlist set 126S is executed, according to any conditionreproducible in a system, such as video resolution.

As shown in FIG. 9, however, if the playlist set designated by thepointer 200PT consists of only one playlist, i.e. if the playlist set126S shown in FIG. 3 is replaced by a single playlist 126, the tileelement 200-2 may logically consist of the pre-command 200PR or 126PR,the playlist 126 to be reproduced during the reproduction operation, thepost command 200PS or 126PS, and the next information 200-6N. In thiscase, once the playlist set is designated for the reproduction, thesingle playlist 126 is reproduced, regardless of the conditionreproducible in the system.

Again in FIG. 3, in the object information file 130, the storageposition (i.e. the logical address of the reproduction object) in theobject data file 140 for each item constructed in each playlist 126,and/or various attribute information relating to the reproduction of theitem are stored. Particularly in this embodiment, the object informationfile 130 stores the AU table 131 including a plurality of AU (AssociateUnit) information 132I (AU #1-#q) as mentioned below, the ES (ElementaryStream) map table 134 and other information 138.

The object data file 140 stores a plurality of TS objects 142 (TS #1object-TS #s object) for each transport stream (TS), i.e. entity data ofcontents to be actually reproduced.

Incidentally, four kinds of file discussed with reference to FIG. 3 canbe further divided into a plurality of files respectively to be stored.All these files may be managed by the file system 105. For example, theobject data file 140 can be divided into a plurality of files such asobject data file #1, object data file #2 and so on.

As shown in FIG. 10, the TS object 142 shown in FIG. 3, as a logicallyreproducible unit, may be divided into a plurality of aligned units 143each having 6kB of data amount. The head of the aligned units 143 isaligned with the head of the TS object 142. Each aligned unit 143 isfurther divided into a plurality of source packets 144 each having 192Bof data amount. The source packet 144 is a physically reproducible unit,on the basis of which (i.e. packet by packet) at least the video data,the audio data and the sub-picture data from among the data on theoptical disc 100 are multiplexed, and other information may bemultiplexed in the same manner. Each source packet 144 includes thecontrol information 145 having 4B of data amount to control thereproduction, such as the packet arrival time stamp or the likeindicating the reproduction start time point of the TS (TransportStream) packet on the reproduction time scale, and includes the TSpacket 146 having 188B of data amount. The TS packet 146 (also referredto as “TS packet payload”) has a packet header 146 a at the headthereof. In the TS packet payload 146, the video data may be packetizedas the “video packet”, the audio data may be packetized as the “audiopacket”, or the sub-picture data may be packetized as the “sub-picturepacket”, otherwise other data may be packetized.

Next, with reference to FIG. 11 and FIG. 12, an explanation is made onthe multi-recording of the video data, the audio data, the sub-picturedata and the like in the transport stream format on the optical disc 100as shown in FIG. 2B, by the TS packet 146 shown in FIG. 4. FIG. 11conceptually illustrates that the elementary stream (ES) for program #1(PG1) in the upper stage and the elementary stream (ES) for program #2(PG2) in the middle stage are multiplexed, and the transport stream (TS)for these two programs (PG1&2) is formed, under an assumption that ahorizontal axis is defined as a time axis. FIG. 12 conceptuallyillustrates an image of the TS packets multiplexed in one transportstream (TS), as a packet array along the time.

As shown in FIG. 11, the elementary stream for program #1 (in the upperstage) may be formed by discretely arranging TS packets 146 obtained bypacketizing the video data for program #1, along the time axis(horizontal axis). The elementary stream for program #2 (in the middlestage) may be formed by discretely arranging TS packets 146 obtained bypacketizing the video data for program #2, along the time axis(horizontal axis). Then, these TS packets 146 are multiplexed so thatthe transport stream (in the lower stage) for two programs is made.Incidentally, omitted for convenience of explanation in FIG. 11, theelementary stream made of TS packets obtained by packetizing the audiodata as the elementary stream for program #1, and/or the sub-picturestream made of TS packets obtained by packetizing the sub-picture datamay be multiplexed similarly, as shown in FIG. 2B. In addition to this,the elementary stream made of TS packets obtained by packetizing theaudio data, as the elementary stream for program #2, and the sub-picturestream made of TS packets obtained by packetizing the sub-picture datamay be multiplexed similarly.

As shown in FIG. 12, in this embodiment, a plurality of TS packets 146multiplexed as such forms one TS stream. Then, a plurality of TS packets146 in the multiplexed form is multi-recorded onto the optical disc 100,with the information such as the packet arrival time stamp 145 and thelike being added. Incidentally, in FIG. 12, the TS packet 146 consistingof the data forming program #i (i=1, 2, 3) is indicated by “element (i0j)”, wherein, j (j=1, 2, . . . ) is a sequential number for each streamcomposing the program. This (i0 j) is defined as a packet ID which is anidentification number of the TS packet 146 for each elementary stream.This packet ID is fixed at an inherent value for a plurality of TSpackets 146 to be multiplexed at the same time point, so that theplurality of TS packets 146 are distinguished from each other even ifmultiplexed at the same time point.

Furthermore, in FIG. 12, the PAT (Program Association Table) and the PMT(Program Map Table) are also packetized by the TS packet 146 unit andmultiplexed. The PAT among them stores a table indicating a plurality ofPMT packet ID's. Particularly, the PAT is defined by MPEG2 standard sothat (000) is given as a predetermined packet ID, as shown in FIG. 12.That is, from among a plurality of packets multiplexed at the same timepoint, the TS packet 146 obtained by packetizing the PAT is detected, asthe TS packet 146 whose packet ID is (000). The PMT stores a tableindicating the packet ID for each elementary stream forming each programin one or more programs. Any packet ID can be given to the PMT, andtheir packet IDs are indicated by the PAT detectable with the packet ID(000) as mentioned above. Therefore, among a plurality of packetsmultiplexed at the same time point, the TS packets 146 obtained bypacketizing the PMT (i.e. TS packets 146 to which packet IDs (100),(200) and (300) are given in FIG. 12) are detected on the basis of thePAT.

In the case that the transport stream as shown in FIG. 12 is transferreddigitally, the tuner refers to the PAT and the PMT constructed as suchand thereby extracts the multiplexed packets corresponding to thedesired elementary stream and decodes the extracted packets.

In this embodiment, the packets of these PAT and PMT are included as theTS packets 146 to be stored in the TS object 142 shown in FIG. 10. Thatis, when the transport stream as shown in FIG. 12 is transferred, thetransferred stream can be directly recorded onto the optical disc 100,which is a great advantage.

Furthermore in this embodiment, these PAT and PMT recorded as such arenot referred to when the optical disc 100 is reproduced. Instead,referring to the AU table 131 and the ES map table 134, shown in FIG. 3and mentioned in detail later, makes it possible to perform thereproduction effectively and apply to the complicated multi-visionreproduction or the like. For this, in this embodiment, a relationshipbetween packets and the elementary stream obtained by referring to thePAT and the PMT on decoding or recording for example is stored in theobject information file 130, in a form of AU table 131 and ES map table134, without packetizing or multiplexing.

Next, with reference to FIG. 13, the logical structure of data on theoptical disc 100 is discussed. FIG. 13 schematically illustrates thelogical structure of data on the optical disc 100, focusing on thedevelopment from the logic hierarchy to the object hierarchy or theentity hierarchy.

In FIG. 13, one or more titles 200 that are a logical large unit such asone movie or one TV program are recorded onto the optical disc 100, Eachtitle 200 includes one or more title elements 200-2. Each title element200-2 logically consists of a plurality of playlist sets 126S. In eachtitle element 200-2, the plurality of playlist sets 126S may have asequential structure or may have a branch structure.

Incidentally, in the case of a simple logical structure, one titleelement 200-2 consists of one playlist set 126S. Furthermore, oneplaylist set 126S consists of one playlist 126. On the other hand, it ispossible to refer to one playlist set 126S by a plurality of titleelements 200-2 or a plurality of titles 200.

Each playlist 126 is logically made of a plurality of items (playitems)204. In each playlist 126, a plurality of items 204 may have thesequential structure or may have the branch structure. On the otherhand, it is possible to refer to one item 204 by a plurality ofplaylists 126. The aforementioned in-point information and out-pointinformation recorded on/in the item 204 logically designates thereproduction range of the TS object 142. Then, the object information130 d of the logically designated reproduction range is referred to andthereby the reproduction range of the TS object 142 is physicallydesignated, via the file system finally. Here, the object information130 d includes various information to reproduce the TS object 142, suchas the attribute information of the TS object 142, the ES addressinformation 134 d and the like required for the data search in the TSobject 142 (incidentally, the ES map table 134 shown in FIG. 3 includesa plurality of ES address information 134 d).

Then, when the information record reproduction apparatus reproduces theTS object 142 as mentioned below, a physical address to be reproduced inthe TS object 142 is obtained from the item 204 and the objectinformation 130 d so that a desired elementary stream is reproduced.

An EP (entry point) map shown in the object information 130 d in FIG. 13and having the plural pieces of ES address information 134 d indicatesan object information table putting the AU table 131 and the ES maptable 134 together here.

Thus, in this embodiment, the in-point information and out-pointinformation recorded on/in the item 204, as well as the ES addressinformation 134 d recorded in the ES map table 134 (see FIG. 3) of theobject information 130 d make it possible to perform the associationfrom the logic hierarchy to the object hierarchy in the reproductionsequence so that the elementary stream is reproduced.

As discussed above, in this embodiment, units of the TS packet 146 aremultiplexed and recorded on the optical disc 100. Thereby, the transportstream including a plurality of elementary streams as shown in FIG. 2Bcan be multiplexed and recorded onto the optical disc 100. In thisembodiment, in the case that digital broadcasting is recorded onto theoptical disc 100, a plurality of programs can be recorded at the sametime, within the restriction of the record rate. Nevertheless, a recordmethod is employed herein, in which a plurality of programs ismultiplexed and recorded for one TS object 142. Now, an explanation ismade on an embodiment of the information record reproduction apparatuscapable of performing such a record processing.

(Information Record Reproduction Apparatus)

Next, with reference to FIG. 14 to FIG. 19, an embodiment of theinformation record reproduction apparatus of the present invention isdiscussed. Here, FIG. 14 is a block diagram of the information recordreproduction apparatus, and FIGS. 15 to 19 illustrate the operationalflow.

In FIG. 14, an information record reproduction apparatus 500 is roughlydivided into a reproduction system and a record system. The apparatus500 is constructed to record the information onto the optical disc 100mentioned above and reproduce the information recorded thereon/therein.In this embodiment, the information record reproduction apparatus 500 isthus for recording and reproduction. Nevertheless, an embodiment of theinformation record apparatus according to the present invention can beconstructed basically with the record system of the apparatus 500 and anembodiment of the information reproduction apparatus according to thepresent invention can be constructed basically with the reproductionsystem of the apparatus 500.

The information record reproduction apparatus 500 is provided with: anoptical pickup 502; a servo unit 503, a spindle motor 504; a decoder506; a demultiplexer 508; a video decoder 511; an audio decoder 512; amemory 512 m; a sub-picture decoder 513; an adder 514; a still picturedecoder 515; a system controller 520; a memory 530; a memory 540; amemory 550; a modulator 606; a formatter 608; a TS object generator 610;a video encoder 611; an audio encoder 612; and a sub-picture encoder613. The system controller 520 includes a file system/logical structuredata generator 521 and a file system/logical structure data reader 522.Furthermore, the memory 530 and a user interface 720 to give a userinput such as title information are connected to the system controller520.

Among these constitutional elements, the decoder 506, the demultiplexer508, the video decoder 511, the audio decoder 512, the memory 512 m, thesub-picture decoder 513, the adder 514, the still picture decoder 515,the memory 540 and the memory 550 mainly construct the reproductionsystem. On the other hand, among these constitutional elements, themodulator 606, the formatter 608, the TS object generator 610, the videoencoder 611, the audio encoder 612 and the sub-picture encoder 613mainly constructs the record system. The optical pickup 502, the servounit 503, the spindle motor 504, the system controller 520, the memory530 and the user interface 720 to give the user input such as titleinformation are generally shared for both the reproduction system andthe record system. Furthermore, for the record system, a TS object datasource 700 (or a PS object data source 700, or a still picture datasource 700 such as bit map data and JPEG data); a video data source 711;an audio data source 712; and a sub-picture data source 713 areprepared. Furthermore, the file system/logical structure data generator521 disposed in the system controller 520 is used mainly in the recordsystem, and the file system/logical structure reader 522 is used mainlyin the reproduction system.

The optical pickup 502 irradiates the optical disc 100 with a light beamLB such as a laser beam, at the first power as reading light for thereproduction, and at the second power with the light beam LB modified aswriting light for recording. The servo unit 503 performs the focusservo, the tracking servo and the like for the optical pickup 502, aswell as the spindle servo for the spindle motor 504, under control ofthe control signal Sc1 outputted from the system controller 520, duringthe reproduction and recording. The spindle motor 504 is controlledunder the spindle servo by the servo unit 503, for rotating the opticaldisc 100 at a predetermined speed.

(i) Structure and Operation of Record System

Next, with reference to FIG. 14 to FIG. 18, a specific structure and theoperation of each constitutional element constructing the record systemof the information record reproduction apparatus 500 are explained ineach case.

(i-1) The case that the already generated TS object is used

This case is discussed, with reference to FIG. 14 and FIG. 15.

In FIG. 14, the TS object data source 700 may be made of the memorystorage such as a video tape, a memory, for storing the TS object dataD1.

Firstly in FIG. 15, each title information (e.g. playlist contents etc.)to be logically constructed on the optical disc 100 using the TS objectdata D1 is inputted into the system controller 520, as the user input 12such as the title information, via the user interface 720. Then, thesystem controller 520 imports the user input 12 such as the titleinformation via the user interface 720 (step S21: Yes, and step S22), Inthis case, the user interface 720, under control of the control signalSc4 from the system controller 520, can perform the input operation inresponse to the contents to be recorded, such as the selection via thetitle menu screen. Incidentally, if the user input is already performed(step S21: No), these processings are omitted.

Next, the TS object data source 700 outputs the TS object data D1, undercontrol of the control signal Sc8 to indicate the data reading from thesystem controller 520. Then, the system controller 520 imports the TSobject data D1 from the TS object data source 700 (step S23), andperforms the data array analysis (e.g. a record data length and thelike) of the TS object data D1, the analysis of each elementary streamstructure (e.g. understanding of ES_PID (elementary stream/packetidentification number)), on the basis of the PAT, the PMT and the likepacketized with the video data as mentioned above, due to the TSanalysis feature in the file system/logical structure data generator 521(step S24).

Next, the system controller 520 makes the file system/logical structuredata generator 521 generate the disc information file 110, the playlistinformation file 120, the object information file 130 and the filesystem 105 (see FIG. 3), as the logical information file data D4, on thebasis of the analysis result of each elementary stream and the TS objectdata D1 data array, as well as the user input 12 such as the importedtitle information (step S25). The memory 530 is used to generate thislogical information file data D4.

Incidentally, variations in which the data about each elementary streamstructure information and the TS object data D1 data array may beprepared in advance are naturally understood or suggested, all of whichare encompassed within a scope of the embodiment.

In FIG. 14, the formatter 608 is for formatting the data array to storeboth the TS object data D1 and the logical information file data D4 onthe optical disc 100. More specifically, the formatter 608 is providedwith a switch Sw1 and a switch Sw2 and is switching-controlled by aswitch control signal Sc5 from the system controller 520. Whenformatting the TS object data D1, it connects the switch Sw1 to a T1side and the switch Sw2 to the T1 side so as to output the TS objectdata D1 from the TS object data source 700. Incidentally, thetransmission control of the TS object data D1 is performed by thecontrol signal Sc8 from the system controller 520. On the other handswhen formatting the logical information file data D4, the formatter 608is switching-controlled by the switch control signal Sc5 from the systemcontroller 520, and connects the switch Sw2 to a T2 side so as to outputthe logical information file data D4.

At step S26 in FIG. 15, (i) the logical information file data D4 fromthe file system/logical structure data generator 521 at the step S25 or(ii) the TS object data D1 from the TS object data source 700 isoutputted through the formatter 608, under the switching-control by theformatter 608 as constructed above (step S26).

The selection output from the formatter 608 is transmitted to themodulator 606 as disc image data D5, and modulated by the modulator 606,and recorded onto the optical disc 100 through the optical pickup 502(step S27). The system controller 520 also executes the disc recordcontrol in this case.

Then, if both the logical information file data D4 generated at the stepS25 and the corresponding TS object data D1 have not been completelyrecorded yet, the operational flow returns to the step S26 to continuethe recording (step S28: No). Incidentally, there is no preference inthe record sequence of the logical information file data D4 and thecorresponding TS object data D1.

On the other hand, if the both have been already recorded, it is judgedwhether or not the recording onto the optical disc 100 is to be ended,on the basis of the presence or absence of an end command (step S29). Ifit is not to be ended (step S29: No), the operational flow returns tothe step S21 to continue the recording. On the other hand, if it is tobe ended (step S29: Yes), a series of record processing ends.

As described above, the information record reproduction apparatus 500performs the record processing in the case of using the already preparedTS object.

Incidentally, the example in FIG. 15 shows that the logical informationfile data D4 and the corresponding TS object data D1 are outputted atthe step S26, after preparing the logical information file data D4 atthe step S25. However, it is also possible to output the object data D1and/or record the object data D1 onto the optical disc 100 before thestep 525, so that the logical information file data D4 is generatedand/or recorded after or in parallel with this recording.

Additionally, instead of the TS object data source 700, the PS objectdata source or the still picture data source may be used. In this case,the above-mentioned record processing to the TS object data D1 isexecuted to the still picture data such as the PS object data, the bitmap data and the JPEG data, instead of the TS object data D1. Then, inthe object data file 140, the PS object data or the still picture objectdata is stored in addition to or instead of the TS object 142 (see FIG.3). The respective logical information related to the PS object data orthe still picture object data is generated under the control of thesystem controller 520 to be stored in the disc information file 110, theplaylist information file 120 and the object information file 130.

(i-2) The Case of Receiving and Recording the Transport Stream on Air

This case is explained with reference to FIG. 14 and FIG. 16.Incidentally, in FIG. 16, the same steps as those in FIG. 15 have thesame step reference numbers, and their explanation is omitted asoccasion demands.

Again, in this case, the similar processing is performed, as is “thecase of using the already prepared TS object” described above.Therefore, the following explanation is focused on the differences fromthis case.

In the case of receiving and recording the transport stream on air, theTS object data source 700 is provided with a receiver (set top box) forreceiving the digital broadcast on air, for example, receives the TSobject data 01, and transmits it to the formatter 608 in real time (stepS41). At the same time, reception information D3 (i.e. informationcorresponding to the data transmitted through the receiver and theinterface of the system controller 520) including the programconstruction information and the belowmentioned ES_PID information,which are deciphered upon receiving, is imported into the systemcontroller 520 and is stored into the memory 530 (step S44).

In the meantime, the TS object data D1 outputted to the formatter 608 isoutputted to the modulator 606 under the switching-control by theformatter 608 (step S42), and is recorded onto the optical disc 100(step S43).

Along with these operations, using the program construction informationand the ES_PID information included in the reception information D3imported upon receiving and stored in the memory 530, the filesystem/logical structure data generator 521 prepares the logicalinformation file data D4 (step S24 and step S25). Then, after thecompletion of recording a series of the TS object data D1, this logicalinformation file data D4 is additionally recorded onto the optical disc100 (step S46 and step S47). Incidentally, these steps S24 and S25 maybe performed after the step S43.

Moreover, as the occasion demands (e.g. in the case of editing oneportion of the title, or the like), by adding the user input 12 of thetitle information and the like from the user interface 720 to theprogram construction information and the ES_PID information stored inthe memory 530, it is possible to prepare the logical information filedata D4 by the system controller 520 and additionally record this ontothe optical disc 100.

As described above, the information record reproduction apparatus 500performs the record processing in the case of receiving the transportstream on air and recording it in real time.

Incidentally, if all the reception data obtained when broadcasting isonce stored into an archive apparatus, and then, if this is used as theobject source 700, the same processing as that in “the case of using thealready prepared TS object” will do.

(i-3) The Case of Recording the Video Data, the Audio Data and theSub-picture Data

This case is explained with reference to FIG. 14 and FIG. 17.Incidentally, in FIG. 17, the same steps as those in FIG. 15 have thesame step reference numbers, and their explanation is omitted asoccasion demands.

In the case of recording the video data, the audio data, and thesub-picture data, which are individually prepared in advance, the videodata source 711, the audio data source 712, and the sub-picture datasource 713 are individually provided with the memory storage, such as avideo tape and a memory, and store a video data DV, an audio data DA,and a sub-picture data DS, respectively.

These data sources are controlled by the control signal Sc8 giving aninstruction for reading out the data from the system controller 520, andthey transmit the video data DV, the audio data DA, and the sub-picturedata DS, to the video encoder 611, the audio encoder 612, and thesub-picture encoder 613, respectively (step S61). Then, the videoencoder 611, the audio encoder 612, and the sub-picture encoder 613execute a predetermined type of encode processing (step S62).

The TS object generator 610 is controlled by a control signal Sc6 fromthe system controller 520 and converts the data encoded in this mannerto the TS object data constituting the transport stream (step S63). Inthis case, the data array information of each TS object data (e.g. arecord data length and the like) and the construction information ofeach elementary stream (e.g. the ES-PID, as described later, and thelike) are transmitted as information 16 from the TS object generator 610to the system controller 520 and are stored into the memory 530 (stepS66).

On the other hand, the TS object data generated by the TS objectgenerator 610 is transmitted to the T2 side of the switch Sw1 of theformatter 608. Namely, when formatting the TS object data from the TSobject generator 610, the formatter 608 is switching-controlled by theswitch control signal Sc5 from the system controller 520 to shift theswitch Sw1 to the T2 side and the switch Sw2 to the T1 side, therebyoutputting the TS object data (step S64). Then, this TS object data isrecorded onto the optical disc 100 through the modulator 606 (step S65).

Along with these operations, using the data array information of each TSobject data and the construction information of each elementary streamimported as the information 16 into the memory 530, the filesystem/logical structure data generator 521 prepares the logicalinformation file data D4 (step S24 and step S25). Then, after thecompletion of recording a series of the TS object data D2, the logicalinformation file data D4 is additionally recorded onto the optical disc100 (step S67 and step S68). Incidentally, the step S24 and the step S25may be processed after the step S65.

Moreover, as the occasion demands (e.g. in the case of editing oneportion of the title), by adding the user input 12 such as the titleinformation and the like from the user interface 720 to theseinformation stored in the memory 530, it is possible to prepare thelogical information file data D4 by the file system/logical structuregenerator 521 and additionally record this onto the optical disc 100.

As described above, the information record reproduction apparatus 500performs the record processing in the case of recording the video data,the audio data, and the sub-picture data, which are individuallyprepared in advance.

Incidentally, this record processing is applicable even when recordingan arbitrary content the user has.

(i-4) The Case of Recording the Data by Authoring

This case is explained with reference to FIG. 14 and FIG. 18.Incidentally, in FIG. 18, the same steps as those in FIG. 15 have thesame step reference numbers, and their explanation is omitted asoccasion demands.

In this case, by combining the above described three types of recordprocessing in the three cases, an authoring system generates the TSobject, the logical information file data, and the like in advance (stepS81), and then completes the processing until switching-controlperformed at the formatter 608 (step S82). Then, the informationobtained by this operation is transmitted, as the disc image data D5, tothe modulator 606 equipped in front of and/or behind an original disccutting machine (step S83), and this cutting machine prepares theoriginal disc (step S84).

(ii) Structure and Operation in Reproduction System

Next, the specific structure and operation of each constitutionalelement constituting the reproduction system of the information recordreproduction apparatus 500 is explained with reference to FIG. 14 andFIG. 19.

In FIG. 14, via the user interface 720, the title to be reproduced fromthe optical disc 100, its reproduction condition and the like areinputted to the system controller 520, as the user input 12 such as thetitle information and the like. In this case, under control of thecontrol signal Sc4 from the system controller 520, the input processingsuitable for the content to be reproduced, such as a selection on atitle menu screen, can be achieved by the user interface 720.

Responding to this, the system controller 520 controls the discreproduction with respect to the optical disc 100, and the opticalpickup 502 transmits a reading signal S7 to the demodulator 506.

The demodulator 506 demodulates a recorded signal recorded onto theoptical disc 100 from this reading signal S7, and outputs it asdemodulated data DB. The logical information file data (i.e. the filesystem 105, the disc information file 110, the P list information file120, and the object information file 130, shown in FIG. 3) included inthis demodulated data D8 as being a not-multiplexed information part issupplied to the system controller 520. On the basis of this logicalinformation file data, the system controller 520 executes variousreproduction control, such as processing of determining a reproductionaddress and controlling the optical pickup 502.

Meanwhile, according to whether the modulated data D8 includes the TSobject data as the multiplexed information part, the still picture dataor both of them, a switch Sw3 is controlled by a control signal Sc1outputted from the system controller 520 to be switched on the side ofthe demultiplexer 508, i.e., on the T1 side, or on the side of the stillpicture decoder 515, i.e., on the T2 side. Thereby, selectively, the TSobject data is supplied to the demultiplexer 508, and the still picturedata is supplied to the still picture decoder 515.

On the other hand, the demultiplexer 508 is controlled by the controlsignal Sc2 from the system controller 520, and demultiplexes the TSobject data, included in the demodulated data D8, serving as themultiplexed information portion. The control signal Sc2 is transmittedso that the demultiplexing is started after the completion of the accessto the reproduction position address under the reproduction control bythe system controller 520.

The video packet, the audio packet and the sub-picture packet aretransmitted respectively from the demultiplexer 508 and suppliedrespectively to the video decoder 511, the audio decoder 512 and thesub-picture decoder 513.

As a previous unit of the audio decoder 512, the memory 512 m isprovided. The memory 512 m has a function of a buffer of the audio datawhen the audio data is reproduced in accordance with the reproduction ofthe still picture in a browseable slide show, which will be describedlater. Namely, the memory 512 m always maintains predetermined amount ofaudio data so that the audio reproduction is never interrupted in thebrowseable slide show, and outputs it to the audio decoder 512. To thememory 512 m, a control signal Sc45 is supplied from the systemcontroller 520. The system controller 520 manages a writing address anda reading address of the audio data to the memory 512 m by the controlsignal Sc45. At the same time, the system controller 520 checks andcontrols the amount of the audio data stored in the memory 512 m so thatthe audio data is sufficient.

In the decoder 511, the audio decoder 512 and the sub-picture decoder513, the video data DV, the audio data DA and the sub-picture data DSare decoded, respectively. At this time, the sub-picture data DS issupplied to the adder 514 via the memory 540. Under the control by thecontrol signal Sc5 from the system controller 520, the sub-picture dataDS is outputted from the memory 540 at the predetermined timing orselectively. Then, the sub-picture data DS is suitably superimposed onthe video data DV. Namely, the timing and necessity of the superimposingcan be controlled as compared with the case that the sup-picture dataoutputted from the sup-picture decoder 513 is directly superimposed. Forexample, by the output control with the control signal Sc5, it becomespossible that, on the main video, a caption with the sub-picture is oris not suitably displayed or a menu screen with the sub-picture is or isnot suitably displayed.

Incidentally, although the packets obtained by packetizing the PAT orthe PMT, included in the transport stream shown in FIG. 6, are includedas a part of the demodulated data D8, respectively, they are discardedor abandoned at the demultiplexer 508.

The adder 514 is controlled by a control signal Sc3 giving aninstruction of the mixing from the system controller 520, and mixes orsuperimposes in a predetermined timing the video data DV and thesub-picture data DS, which are respectively decoded at the video decoder511 and the sub-picture decoder 513, The result is outputted as a videooutput from the information record reproduction apparatus 500 to a TVmonitor, for example.

On the other hand, the audio data DA decoded at the audio decoder 512 isoutputted as an audio output from the information record reproductionapparatus 500 to an external speaker, for example.

Instead of or in addition to the reproduction processing of the videodata DV and the sub-picture data DS, when the still picture data isincluded in the decoded data D8, the still picture data is supplied tothe still picture decoder 515 via the switch Sw3 controlled by thecontrol signal Sc10 outputted from the system controller 520. The stillpicture data such as the decoded bit map data and the JPEG data iscontrolled by the control signal Sc11 from the system controller 520 tobe directly added to the adder 514 via a switch Sw4. Or the stillpicture data is stored in the memory 550 once, via the switch Sw4. Underthe control by the control signal Scl2 outputted from the systemcontroller 520, the still picture data is outputted from the memory 550at the predetermined timing or selectively. Then, the outputted stillpicture data is supplied to the adder 514 via the switch Sw5. Thereby,the still picture data is suitably superimposed on the video data DV andthe sub-picture data DS. Namely, the timing and necessity of thesuperimposing can be controlled as compared with the case that the stillpicture data outputted from the still picture decoder 515 is directlysuperimposed. For example, by the output control with using the controlsignal Sc12, it becomes possible that the still picture such as the menuscreen or the window screen or the still picture serving as thebackground image, in which the still picture data is used, is or is notsuitably displayed on the main video and the sub-picture.

Additionally, the still picture data may be separately outputted througha passage (not shown) via the switch Sw5 switched on the T2 side, underthe control by the control signal Sc13 from the system controller 520.Or, if the switch Sw5 is switched on the T2 side, no still picture datamay be outputted from the switch Sw5. Here, the specific example of areproduction processing routine by the system controller 520 isexplained with reference to a flow chart of FIG. 19.

In FIG. 19, it is assumed that as an initial condition, the recognitionof the optical disc 100 in the reproduction system and the recognitionof a volume structure and a file structure by the file system 105 (seeFIG. 3) have been already completed by the system controller 520 and thefile system/logical structure data reader 522 inside of the systemcontroller 520. Here, an explanation is made on the operational flowafter obtaining the total number of the total titles from the discgeneral information 112 in the disc information file 110 and thenchoosing or selecting one title 200 from among them.

Firstly, the selection of the title 200 is performed via the userinterface 720 (step S211). Responding to this, the system controller 520obtains the information about the reproduction sequence from a readingresult of the file system/logical structure data reader 522.Incidentally, in the selection of the title 200, the desired titleelement(s) 200-2 (see FIG. 4) may be selected from among a whole titleelements 200-2 composing the title 200, with the aid of an externalinput operation by the user with using a remote controller and the like,or one title element 200-2 may be selected automatically depending on asystem parameter or the like adjusted for the information recordreproduction apparatus 500.

Then, contents of a plurality of playlists 126 composing a playlist set126S corresponding to the selected title 200 (title element 200-2) areobtained. Here, as a processing at a logic hierarchy, the informationabout the each playlist 126 structure and each item 204 composing eachplaylist (see FIG. 5, FIG. 6 and FIG. 13) is obtained (step S212).

Then, contents of the playlist 126 to be reproduced is obtained fromamong a plurality of playlists 126 obtained at step S212. For example,herein, the reproduction is started from a playlist #1, and the contentsof the corresponding playlist 126 is obtained (step S213). The contentsof the playlist 126 may be one or more playlist elements 126-2 (see FIG.5), which are obtained by the obtaining processing at step S213.

Then, the pre-command 126PR (see FIG. 5) included in this playlist 126is executed (step 5214). Incidentally, it is possible or the pre-command126PR to select one from among a plurality playlist 126, which composesthe playlist set 126S with a certain relationship of the plurality ofplaylists 126. If the playlist element 126-2 composing the playlist 126does not have the pre-command 126PR, this processing is omitted.

Then, the TS object 142 (see FIG. 3 and FIG. 10) to be reproduced isdetermined (step S215), on the basis of the item 204 (see FIG. 5 to FIG.7) identified by the playlist 126 obtained at step S213. Morespecifically, on the basis of the item 204, the object information file130 (see FIG. 3) relating to the TS object 142 as the reproductiontarget is obtained and a stream number, address and the like of the TSobject 142 to be reproduced are identified.

Incidentally, in this embodiment, also the belowmentioned AU(Association Unit) information 132I and PU (Presentation Unit)information 302I are obtained as the information stored in the objectinformation file 130. On the basis of these information, theaforementioned logic hierarchy is associated with the object hierarchy(see FIG. 13).

Then, the reproduction of the TS object 142 determined at step S21S isactually started. That is, on the basis of the processing at the logichierarchy, the processing at the object hierarchy is started (stepS216).

During the reproduction of the TS object 142, it is judged whether ornot the next item 204 composing the playlist 126 to be reproduced exists(step S217). Then, insofar as the next item 204 exists (step S217: Yes),the process goes back to the step S215 to repeat the aforementioneddetermination and the reproduction of the TS object 142.

On the other hand, at the judgment at step S217, if it is judged thatthe next item 204 does not exist (step S217: No), the post command 126PS(see FIG. 5) corresponding to the presently executed playlist 126 isexecuted (step S218). Incidentally, if the playlist element 126-2composing the playlist 126 does not have the post command 126PS, thisprocessing is omitted.

Then, it is judged whether or not the next playlist 126 composing theselected title 200 exists (step S219). If exists (step S219: Yes), theprocess goes back to the step S213 to repeat the processings followingobtaining the playlist 126 to be reproduced.

On the other hand, at the judgment at step S219, if it is judged thatthe next playlist 126 does not exist (step S219: No), i.e. if the allplaylists 126 to be reproduced corresponding to the title 200 selectedat step S211 are completely reproduced, a series of reproductionoperations or processings is terminated.

As discussed above, the information record reproduction apparatus 500 inthis embodiment reproduces the optical disc 100.

(Method of Selecting Playlist in Playlist Set)

In the present embodiment, the playlist 126 corresponding to the desiredcontents information is suitably selected from the playlist set 126Sincluded in the reproduced playlist information file 120.

The pre-command 200PR (see FIG. 4) included in the title element 200-2has a playlist selection command group list in which a selectioncondition is written for each playlist 126. The selection of theplaylist may be performed in accordance with the selection condition,for example. In addition, the selection of the playlist may be performedin accordance with the attribute information (e.g., informationindicating an attribute of the contents information related to theplaylist, such as a video resolution for a video function, distinctionof progressive/interleave, a video codec, a number of audio channels, aaudio codec and the like) added to each playlist 126 stored in theplaylist set 126S. Alternatively, the selection may be performed inaccordance with the playlist set control information, included in thetitle element 200-2, in which the selection condition is stored for eachplaylist. By such the selection, the playlist corresponding to thedesired contents information such as the desired program, the desiredparental block, the desired angle block and the like can be selected,for example. Also, the playlist reproducible by the informationreproduction system and preferably capable of making the best use of thevideo reproduction function and a sound reproduction function of theinformation reproduction system can be selected, for example.

(Browseable Slide Show)

Next, the description will be given of the browseable slide showaccording to the present invention. The browseable slide show is toreproduce still picture sets including the plural still pictures inorder. In this case, along with the reproduction of the still picture,the audio such as the BGM can be reproduced, for example. In thebrowseable slide show according to the present invention, the stillpicture is mainly reproduced, and the audio can be reproduced insynchronization with the reproduction of the still picture. Namely, thedisplay clock (time axis) of the still picture is used as reference, thestill picture is regarded as main contents, and the reproduction of theaudio is controlled during a display time period (time axis) of thestill picture.

The reproduction time of default is logically set to each still picture.The reproduction time may be a finite value or an infinite value. Thatthe reproduction time of the still picture is the finite value meansthat, if there is no user operation (display of the subsequent stillpicture), the reproduction of the still picture automatically ends afterthe reproduction time passes. For example, when the reproduction time ofa certain still picture is set to 3 seconds, the still picture isdisplayed for 3 seconds in the browseable slide show. After that, thesubsequent still picture is reproduced, or the browseable slide showends. Meanwhile, that the reproduction time of the still picture is theinfinite value means the still picture is maintained displayed until thedisplay of the subsequent still picture is instructed by the useroperation. Namely, the reproduction instruction of the subsequent stillpicture by the user operation includes user's pushing of “Next” buttonon the remote controller of the reproduction apparatus, for example.

As for the browseable slide show, “still picture repeat flag” and “audiorepeat flag” are set as information defining the reproduction method ofthe still picture and the according reproduction method of the audio.The information is included in the playlist element 126-2 shown in FIG.5, as will be described later.

“Still picture repeat flag” is information defining whether or not torepeatedly reproduce the plural still pictures in the browseable slideshow. When the still picture repeat flag is set to the ON state, thestill picture set including the plural still pictures are repeatedlyreproduced. When the still picture repeat flag is set to an OFF state,the reproduction of the still picture set is performed only once andends.

In the case that the still picture repeat flag is set to the ON state,the end timing of reproducing the still picture set is when the userinputs a reproduction cancel instruction of the still picture in thebrowseable slide show. In addition, in the case that the still picturerepeat flag is set to the OFF state, the end timing is when the userinputs the reproduction instruction of the subsequent still pictureduring the reproduction of the final still picture or when the finitetime of the default passes.

“Audio repeat flag” is information defining whether or not to repeatedlyreproduce the audio which is reproduced simultaneously with the stillpicture in the browseable slide show. When the audio repeat flag is setto the ON state, the audio reproduced simultaneously with the stillpicture is repeatedly reproduced until the end of reproducing the stillpicture set. When the audio repeat flag is set to the OFF state, theaudio reproduced simultaneously with the still picture is reproducedonce.

In the browseable slide show of the present invention, since the audiois reproduced with using the display clock (time axis) of the stillpicture as reference, the reproduction time (maximum reproduction time)of the audio is the time in which the still picture exists. However, inthe browseable slide show, since the reproduction time of the stillpicture is changeable by the user operation as described above, byproviding the audio repeat flag, the reproduction time of the audioaccording to the reproduction of the still picture is defined.

FIG. 20 to FIG. 23 schematically show reproduction examples of thebrowseable slide show by setting the still picture repeat flag and theaudio repeat flag. In the examples in FIG. 20 to FIG. 23, it is assumedthat the still picture set includes three still pictures #1 to #3 andone audio for the browseable slide show is prepared.

FIG. 20 schematically shows a practical example of the browseable slideshow in the case that the still picture repeat flag is set to the ONstate and the audio repeat flag is set to the OFF state. Once thebrowseable slide show starts, the still picture #1 is first reproduced.Every time the reproduction of the next still picture is instructed, thestill pictures #2, #3, #1, #2 . . . are reproduced. Namely, the stillpictures #1 to #3 are repeatedly reproduced. When the reproduction endinstruction is received, the reproduction of the still picture ends. Inthe case that the above-mentioned reproduction time of the still pictureis set to the finite value (e.g., 3 seconds), the reproductioninstruction of the next still picture is given when the reproductiontime passes or when the reproduction instruction of the next stillpicture is given by the user's operation. Meanwhile, in the case thatthe reproduction time of the still picture is set to the infinite value,the reproduction instruction of the next still picture is given when thereproduction instruction of the next still picture is given by theuser's operation. In addition, since the audio repeat flag is set to theON state, the reproduction of the audio is continued during thereproduction of the still picture. Therefore, when the reproduction timeof the audio is shorter than the total reproduction time of the stillpicture, the same audio is repeatedly reproduced.

FIG. 21 shows a practical example of the browseable slide show in thecase that the still picture repeat flag is set to the ON state and theaudio repeat flag is set to the OFF state. The reproduction of the stillpicture is similar to the example shown in FIG. 20. However, since theaudio repeat flag is set to the OFF state, the reproduction of the audiois performed once and ends. In this case, after the reproduction of theaudio ends, only the still picture is displayed, and no sound isoutputted. But, in a case of the audio data unsuitable for the repeatedreproduction due to a type and contents of the audio, the flag settingillustrated in FIG. 21 becomes effective.

FIG. 22 shows a practical example of the browseable slide show in thecase that the still picture repeat flag is set to the OFF state and theaudio repeat flag is set to the ON state, Every time the reproductioninstruction of the next still picture is received, the still pictures#1, #2 and #3 are reproduced in order. When the reproduction endinstruction is received during the reproduction of the still picture #3,the reproduction ends. When the reproduction instruction of the nextstill picture is received during the reproduction of the still picture#3, the instruction is treated as the reproduction end instruction.Additionally, since the audio repeat flag is set to the ON state, thereproduction of the audio is continued during the reproduction of thestill picture, Therefore, when the reproduction time of the audio isshorter than the total reproduction time of the still picture, the sameaudio is repeatedly reproduced.

FIG. 23 shows a practical example of the browseable slide show in a casethat the still picture repeat flag and the audio repeat flag are set tothe OFF state. The reproduction of the still picture is similar to theexample shown in FIG. 22. In addition, since the audio repeat flag isset to the OFF state, the reproduction of the audio is performed onlyonce and ends.

As described above, in the browseable slide show according to thepresent invention, by setting the still picture repeat flag, it can bedefined whether to reproduce the still picture only once or torepeatedly reproduce it. In addition, by setting the audio repeat flag,it can be also defined whether to repeatedly reproduce the audio or toreproduce it only once during the reproduction of the still picture.Thus, by setting the accompanying reproduction method of the audio withreference to the reproduction of the still picture, the browseable slideshow can be executed in various manners.

Next, the description will be given of the specific structure of theplaylist information table used for executing the browseable slide show,with reference to FIG. 24. FIG. 24 is a conceptual view showing aconcrete example of the playlist information file particularly capableof executing the browseable slide show,

In FIG. 24, the playlist information table includes the playlist generalinformation, playlist pointer table and the playlist #i (1, 2, . . . )information table.

Among these “playlist general information” has general informationrelated to the entire playlist information table such as the size of theplaylist and the total number of the playlists.

“Playlist pointer table” has the playlist #i (i=1, 2, . . . ) pointershowing a storage address of the playlist #i (i=1, 2, . . . )information, respectively.

“Playlist #i information table” has (i)playlist #i (i=1, 2, . . . )general information, (ii)playlist #i (i=1, 2, . . . ) item informationtable and (iii)playlist #i (i=1, 2, . . . ) sub-item information table.

In this embodiment, the playlist #i information table is divided intotwo tables: the playlist #i (i=1, 2, . . . ) item information tableincluding item information constructing the playlist informationdefining the reproduction sequence of the still picture in thebrowseable slide show; and the playlist #i (i=1, 2, . . . ) sub-iteminformation table including the item information (suitably called“sub-item information” in this embodiment) constructing the playlistinformation defining the reproduction sequence for executing thebrowseable slide show. That is, in this embodiment, the playlist forreproducing the still picture in the browseable slide show includes theitems, and the playlist for reproducing the audio to be reproducedsimultaneously with the still picture includes the sub-items.

“Playlist #i general information” has the total number (“2” in thisembodiment) of items constructing the playlist #i, the total number (“1”in this embodiment) of sub-items and other information.

“Playlist #i item information table” includes the item information #i(two pieces of item information in this embodiment). Each iteminformation has the type (item type) of the item information, the stillpicture repeat flag, the object number in the object information fileand the AU number in the AU table in the object information file 130.

In the playlist item information table corresponding to the stillpicture in the browseable slide show, the item type is defined as“browseable slide show”, for example, Additionally, in the case of theON state, the still picture repeat flag instructs to return to thedisplay of the still picture at the top of the still picture set whenthe reproduction instruction of the next still picture is receivedduring the display of the final still picture. Meanwhile, in the case ofthe OFF state, the still picture repeat flag instructs to finish thereproduction of the still picture and to move to there production of thenext item when there production instruction of the next still picture isreceived during the display of the final still picture.

The still picture repeat flag can be set to “CONTINUE”. “CONTINUE”indicates one reproduction sequence including the next item (i.e., theplural items are controlled as one item). Also, the still picture repeatflag can be set to “END”, which is information used in pair with“CONTINUE” and which specifically indicates the end of one reproductionsequence. In this case, in addition to “END”, the still picture repeatflag structurally includes “ON” or “OFF” information. In the example ofFIG. 24, when the reproduction instruction of the next still picture isreceived during the reproduction of the final still picture of the item#1, the top still picture of the item #2 is reproduced, and when thereproduction instruction of the next still picture is received duringthe reproduction of the final still picture of the item #2, the topstill picture of the item #1 is reproduced. Namely, the still picturerepeat flag is sometimes effective over the plural items. Even if thestill picture repeat flag is not set to “CONTINUE”, the same effect canbe obtained by setting such a rule that “successive items having theitem type of the browseable slide show are regarded as one reproductionsequence”.

“Playlist #i sub-item information table” includes the sub-iteminformation #i (one piece of sub-item information in this embodiment).Each of the sub-item information has the type (sub-item type) of thesub-item information, the audio repeat flag, the reproduction startingposition information, the object number in the object information file,the information indicating the AU number in the AU table in the objectinformation file 130 and the audio reproduction range information.

In the playlist sub-item information table corresponding to the audio inthe browseable slide show, the sub-item type is defined as “audio forbrowseable slide show”, for example. As described above, in the ONstate, the audio repeat flag shows that the audio is repeatedlyreproduced as long as the reproduction of the still picture continues,and in the OFF state, it shows that the reproduction of the audio isonly once.

“Reproduction starting position information” designates the reproductionstarting timing of the audio serving as the sub-item on the time axis ofthe still picture serving as the item. For example, when thereproduction of the audio starts with the first still picture, the itemnumber and the display timing of the still picture is designated, like“Item#1,ES_Tableindex#1”. When the display time information such as PTSis added to each still picture in accordance with the data format of thestill picture (e.g., when I-picture of MPEG is used as the stillpicture), the reproduction starting position information nay designatethe display timing of the still picture by the display time informationof the still picture.

FIG. 25 shows an example of a case that the display time information isnot added to the object itself. Since the display time information isnot added to the still pictures #1 to #5 being the objects, if the PU isformed as shown in FIG. 25, the still pictures are reproduced in theorder of the still pictures #2, #1, #5. If the reproduction of the audiois started simultaneously with the display start of the still picture#1, the reproduction starting position information is designated as“Item#1, index#2”, for example.

FIG. 26 shows an example of a case that the display time information isadded to the object itself, As shown in FIG. 26, the PTS is added to thestill pictures #1 to #5 being the objects as the display timeinformation, respectively. As for the reproduction of the still picture,the still picture to be displayed is designated in the item informationby using the display time information in terms of the range such asPTS=bbb to ddd. Because of the browseable slide show, the PTS of thiscase is used not for showing the actual display time of each stillpicture, but for distinguishing each still picture being the object,Namely, by using the address information, the packet number is obtainedfrom the PTS. In this case, the PU is constructed as shown in FIG. 26.Therefore, when the reproduction of the audio is started simultaneouslywith the display of the still picture #3 for example, the reproductionstarting position information is designated as “item#1,PTS=ccc”.

In addition, “audio reproduction range information” in the sub-iteminformation designates the range of a part of certain audio data to bereproduced as the audio in the browseable slide show. Thereby, theentire or the only arbitrary one part of the specific audio data can bedesignated as the audio to be reproduced in the browseable slide show.

As described above, if the object data is reproduced based on theplaylist information table dividedly having the item informationcorresponding to the still picture and the sub-item informationcorresponding to the audio, it becomes possible to execute thebrowseable slide show for reproducing the audio such as the BGM withusing the time axis of the still picture as reference. At this time, bysetting the still picture repeat flag, it can be defined whether or notto repeatedly display the still picture. Moreover, by setting the audiorepeat flag, it becomes possible to define the reproduction of the audioaccording to the reproduction state of the still picture. Therefore, thestill picture and the audio can be reproduced in various kinds ofmanners.

Next, the description will be given of a process in the informationrecord reproduction apparatus 500 executed in the above-mentionedbrowseable slide show, with reference to FIG. 27 and FIG. 28. FIG. 27 isa flow chart showing the detailed process for determining the object ofthe item (including the item and the sub-item) to be reproduced, whichis executed as a part of the process in step S215 shown in FIG. 19. FIG.28 is a flow chart showing the process for reproducing the browseableslide show shown in FIG. 27. In FIG. 27, the same step numbers are givento the same steps as steps shown in FIG. 19, and their explanation willbe omitted.

In FIG. 27, after the processes in steps S211 to S214 similar to thesteps shown in FIG. 19 are executed, the object of the item to bereproduced is determined with reference to the playlist informationtable shown in FIG. 24 (step S221). Specifically, with reference to theitem type in the item information in the playlist information table, itis determined whether or not the item type is set to the browseableslide show. When the item to be reproduced is not the browseable slideshow (step S221; No), the item is reproduced by a method other than thebrowseable slide show (step S222).

On the other hand, when the item to be reproduced is the browseableslide show (step S221; Yes), the item information subsequent to the itemis checked, and the reproduction sequence of the plural items to bereproduced as the browseable slide show is determined (step S223).Specifically, when “CONTINUE” can be set to the still picture repeatflag as described above, it is determined items up to which itemconstruct one reproduction sequence based on the description of“CONTINUE” in the plural pieces of item information. Instead, when it isruled that “when the plural items having the item type of the browseableslide show are successively provided, they construct one reproductionsequence” in advance, one reproduction sequence is determined withreference to the item type in each of the item information.

In addition, the information related to the audio to be reproduced inthe browseable slide show is obtained with reference to the sub-iteminformation.

In this manner, when the one reproduction sequence is determined, thereproduction of the browseable slide show is executed (step S224).

Afterward, the determination in step S217 similar to the determinationshown in FIG. 19 is performed. When the next item exists (step S217;Yes), the process returns to step S213 and the following process isrepeated in this embodiment. In addition, when the next item does notexist, the post command is executed (step S218), and it is determinedwhether or not the next playlist exists (step S219). When the nextplaylist exists, the process returns to step S212. Meanwhile, when thenext playlist does not exist, the process ends.

Next, the detailed description will be given of the reproduction processof the browseable slide show with reference to FIG. 28. In FIG. 28, thePU (presentation unit) to be reproduced and the object of the stillpicture are first determined with reference to the AU table 131 and theES map table 134 (see FIG. 3) (step S301).

Next, the packet information is obtained by the address information ofthe still picture to be reproduced (step S302). Subsequently, it isdetermined whether or not the audio whose reproduction should be startedexists (step S303) Specifically, the reproduction starting positioninformation in the sub-item information corresponding to the audio to bereproduced is referred to, and it is determined whether or not thereproduction starting timing of the audio arrives.

When it is determined that the audio to be reproduced exists, the packetnumber is obtained based on the address information of the audio to bereproduced (step S304), and the audio data is read into the memory 512 mprovided in front of the audio decoder 512 (step S305). Thereby, thereproduction preparation of the audio is completed. In addition, basedon the packet information obtained in step S302, the still picture datato be reproduced is obtained (step S306). In this manner, thereproduction preparation of the still picture is completed. In thisembodiment, the still picture data is obtained after the audio data isobtained. However, this order may be reversed.

Next, as the browseable slide show, the reproduction of the stillpicture is started (step S307). At this time, when the reproductionstarting position information in the sub-item information defines thatthe reproduction of the audio is started with the reproduction of thestill picture, the reproduction of the audio is started simultaneously.

In this manner, when the reproduction of the browseable slide show isstarted, the system controller 520 monitors the memory 512 m todetermine whether or not the audio data to be reproduced is sufficient(step S308). When the reproduction of the audio is started, the audiodata stored in the memory 512 m is reproduced in order. For the purposeof continuing the reproduction of the audio, the audio data has to beread into the memory 512 m in order. Therefore, the system controller520 monitors the amount of data in the memory 512 m, and starts readingthe audio data in accordance with the progress of the audio reproduction(step S309). Thereby, it is prevented that the audio to be reproduced isinterrupted during the reproduction of the browseable slide show.

Next, the audio reproduction range information in the sub-iteminformation is referred to, and it is determined whether or not thereproduction range of the audio ends (step S310). When the reproductionrange of the audio ends (step S310; Yes), it is determined whether ornot the audio repeat flag in the sub-item information is in the ON state(step 5311). In the case of the ON state, since the audio is repeatedlyreproduced until the end of the reproduction of the still picture asdescribed above, the reproduction of the same audio is started from thebeginning (step S312). Meanwhile, in the case of the OFF state, thereproduction of the audio ends (step S313).

Next, it is determined whether or not the end instruction of thereproduction of the browseable slide show is inputted by the useroperation (step 5314). When it is inputted, the process returns to themain routine shown in FIG. 27. Meanwhile, when it is not inputted,whether or not to display the next still picture is determined (stepS315). In the case that the reproduction time of the still picture isset to the infinite value, it is determined to display the next stillpicture when the reproduction instruction of the next still picture isinputted by the user operation. In addition, in the case that thereproduction time of the still picture is set to the finite value (e.g.,3 seconds), it is determined to display the next still picture when thereproduction time passes. When it is not determined to display the nextstill picture (step S316; No), the process returns to step S308, and thereproduction of the same still picture is continued.

On the other hand, when it is determined to display the next stillpicture (step S316; Yes), it is determined whether or not the next stillpicture is the final still picture (step S316). When it is not the finalstill picture (step S316; No), the next still picture data is obtained,and it is determined whether or not the audio data whose reproductionshould be started simultaneously with the reproduction of the stillpicture exists (step S318). As described above, the reproductionstarting timing of the audio in the browseable slide show is defined bythe reproduction starting position information in the sub-iteminformation. Therefore, the audio is not always reproducedsimultaneously with the first still picture. Namely, the audio issometimes reproduced at the time of starting of the reproduction of thesecond or later still picture or in the middle of the reproduction.Thus, whether or not the audio whose reproduction should be startedexists is determined in step S318.

When no audio whose reproduction should be started exists (step S318;No), the next still picture data is displayed. Then, the process returnsto step S308, and the reproduction of the still picture (if any, theaudio to be reproduced, too) is continued. Meanwhile, when the audiowhose reproduction should be started exists (step S318; Yes), the audiodata is read into the memory 512 m (step S319), and the display of thenext still picture and the reproduction of the audio are started (stepS320). Afterward, the process returns to step S308, and the reproductionis continued.

When the next still picture is determined to be the final still picturein step S316 (step S316; Yes), it is determined whether or not the stillpicture repeat flag in the item information is in the ON state (stepS322). When the still picture repeat flag is in the ON state, the firststill picture data of the reproduction sequence previously determined isobtained, and the reproduction thereof is started (step S323).Afterward, until the end instruction of the browseable slide show isreceived in step S314, the reproduction of the still picture included inthe same reproduction sequence is continued. Meanwhile, when the stillpicture repeat flag is in the OFF state, the browseable slide show ends,and the process returns to the main routine shown in FIG. 27. Since thebrowseable slide show according to the present invention is forreproducing the audio with using the reproduction time axis of the stillpicture as reference as described above, it never happens that only theaudio is reproduced after the reproduction end of the still picture,

(Flow of Access in Reproducing)

Next, with reference to FIG. 29, the description will be given of a flowof an access at the time of the reproduction in the information recordreproduction apparatus 500 using the AU (Associate Unit) information 132and the PU (Presentation Unit) information 302, which are one offeatures in this embodiment, with the logical structure of the opticaldisc 100. FIG. 29 schematically shows the entire flow of the access atthe time of the reproduction with relation to the logical structure ofthe optical disc 100.

In FIG. 29, the logical structure of the optical disc 100 is dividedinto three hierarchies; a logic hierarchy 401, an object hierarchy 403and a logic-object association hierarchy 402 mutually relating the twohierarchies.

In the three hierarchies, the logic hierarchy 4011 logically specifiesvarious kinds of logical information for reproducing the desired titleat the time of the reproduction, the playlist (P list) to be reproducedand the structural contents thereof. In the logic hierarchy 401, discinformation 110 d showing the all tiles 200 on the optical disc 100 iswritten in the disc information file 110 (see FIG. 3), and reproductionsequence information 120 d of the all contents on the optical disc 100is further written in the playlist information file 120 (see FIG. 3)Specifically, the structure of one or plural playlist set(s) 126S iswritten to one or plural title element(s) 200-2 included in each title200 as the reproduction sequence information 120 d, respectively.Moreover, each playlist set 126S includes one or plural playlist (s)126, which the structure of one or plural item(s) 204 (see FIG. 13) iswritten in. At the time of the access of the reproduction, the title 200to be reproduced is specified by the logic hierarchy 401, and thecorrespondent playlist 126 is specified. Further, the correspondent item204 is specified.

Subsequently, the logic-object association hierarchy 402 specifies thecombination and structure of the TS object data 140 d being actual dataon the basis of the information thus specified in the logichierarchy401. The logic-object association hierarchy 402 also specifies anattribute of the TS object data 140 d to be reproduced and a physicalstorage address thereof in order to execute an address conversion fromthe logic hierarchy 401 into the object hierarchy 403. Morespecifically, in the logic-object association hierarchy 402, the objectinformation data 130 d, which classifies blocks of contents constructingeach item 204 into a unit “AU 132” and which classifies each AU 132 intoa unit “PU 302”, is written in the object information file 130 (see FIG.3).

“PU (Presentation Unit) 302” is a unit obtained by relating the pluralelementary streams by the reproduction switch unit to put them together.If there are three audio streams in the PU 302, the user can freelyswitch the three audios (e.g., audio by language) during thereproduction of the vision.

On the other hand, “AU (Associate Unit) 132” is a unit obtained byputting together the plural elementary streams such as the video streamin the TS object used for one title, and it includes one or plural PU(s)302, More specifically, “AU 132” is a unit obtained by indirectlyputting together the elementary stream packet ID (ES_PID) via the PU 302for each TS object. The AU 132 corresponds to a group such as plural TVprograms or plural programs mutually having specific relation in termsof the contents, such as the plural TV programs or programs mutuallyswitchable in multi-origination broadcast program, for example. The PU302 belonging to the same AU 132 corresponds to the group of one orplural elementary stream(s) structuring the plural TV programs or theplural programs mutually switchable by the user operation at the time ofthe reproduction, respectively.

Accordingly, when the AU 132 to be reproduced is specified and the PU302 belonging to the AU 132 is specified, the elementary stream to bereproduced is specified. Namely, without using the PAT and PMT shown inFIG. 12, the desired elementary stream can be reproduced in themulti-recorded elementary streams on the optical disc 100. The morespecific data structures of the AU information 132I and the PUinformation 302I defining the AU 132 and the PU 302 respectively will beexplained later.

The elementary stream actually reproduced is specified or designated bythe ES_PID being the packet ID (see FIG. 12) of the elementary streamfrom the PU information 302. At the same time, by converting theinformation indicating the starting time and ending time of thereproduction into the address information of the elementary stream, thecontents in the specific area (or specific time range) of the specificelementary stream is reproduced.

In this manner, in the logic-object association hierarchy 402, theaddress conversion from the logical address of each item 204 into thephysical address of each PU 302 is performed.

Subsequently, the object hierarchy 403 is the physical hierarchy forreproducing the actual TS object data 140 d. In the object hierarchy403, the TS object data 140 d is written in the object data file 140(see FIG. 3). Specifically, the TS packets 146 structuring the pluralelementary streams (ES) are multiplexed for each time, and the TSpackets 146 are arranged along the time axis. Thereby, the pluralelementary streams are constructed (see FIG. 11). The plural TS packetsmultiplexed for each time correspond to the PU 302 specified by thelogic-object association hierarchy 402 for each elementary stream. It isalso possible that the plural PUs 302 and one elementary stream arerelated (e.g., between the plural switchable TV programs or the pluralswitchable programs, the elementary stream of the same audio data iscommonly used, or the elementary stream of the same sub-picture data iscommonly used).

In this manner, in the object hierarchy 403, the reproduction of theactual object data is executed with using the physical address obtainedby the conversion in the logic-object association hierarchy 402.

As described above, by the three hierarchies shown in FIG. 29, theaccess at the time of the reproduction of the optical disc 100 isexecuted. For convenience, FIG. 29 and an explanation thereof areindicated in such a manner that both of the sub-item and the item otherthan the sub-item are included in “item 204”. Namely, the correspondencefrom the logic hierarchy 401 to the logic-object association hierarchy402 is as shown in the item 204, even if the item is the sub-item or theitem other than the sub-item.

(Structure of Each Information File)

Next, with reference to FIG. 30 to FIG. 37, the description will begiven of a specific example of the data structure in various kinds ofinformation files formed on the optical disc 100 of this embodiment,i.e., (1) the disc information file 110 and the playlist informationfile 120 and (2) the object information file 130, which were explainedwith reference to FIG. 3.

(1) Disc Information File and Playlist Information File:

The description will be given of each component in the concrete exampleof the files and the hierarchical structure between the components, withreference to FIG. 30 to FIG. 36. FIG. 30 to FIG. 36 are conceptual viewsschematically showing the hierarchical structures of the files. In FIG.30 to FIG. 36, the same referential numerals are given to the same file,data and information as those already explained with reference to FIG. 3to FIG. 9, and their explanation are conveniently omitted.

First, as shown in FIG. 30, “title information set” according to thisspecific example is the information set including the disc informationfile 110 and the playlist information file 120 shown in FIG. 3.

The title information set includes one disc header 112 x, the pluralpieces of title information 200 (title information #1, . . . , #n) theplural play (P) list sets 126S (P list set #1, . . . , #n) and otherinformation.

(1-1) Disc Header

First, for the title information sets shown in FIG. 30, the disc header112 x will be explained with reference to FIG. 30 and FIG. 31.

In FIG. 30, the disc header 112 x is illustrated in a form branching offat a right upper portion in the drawing. The disc header 112 x hasplural fields for various kinds of information such as the versionnumber, the total number of titles, the total number of titleinformation and the total number of the play (P) list sets in this orderin FIG. 30, as the information corresponding to the disc generalinformation 112 shown in FIG. 3. The disc header 112 x has the titlestarting address table as the table for the information corresponding tothe title pointer 114-1 shown in FIG. 3. Further, the disc header 112 xhas the play (P) list set starting address table as the table for theinformation corresponding to the playlist set pointer 124 shown in FIG.3, The disc header 112 x has the field for the information indicatingthe attribute of each of the title sets. Moreover, the disc header 112 xhas the title table 112 xtt and the playlist set table 112 xpt.

The disc header 112 x having the plural fields and the plural tablestotally manages the plural titles in the entire recording area on thedisc.

“Version number” is the version number in this standard. According toISO646, the version number is prescribed as “0070”, for example. “Totalnumber of titles” is the total number of titles in the entire recordingarea on the disc, and “Total number of title information” is the totalnumber of title information in the entire recording area on the disc.“Total number of playlist sets” is the total number of playlist sets inthe entire recording area on the disc, and “title starting addresstable” shows the starting address of each title as a relative bytenumber from the top of the title set. The byte number is counted from 0,for example. “Playlist set starting address table” shows the startingaddress of each playlist set as the relative byte number from the top ofthe title set. The byte number is counted from 0, for example. “Titleset attribute” shows the attribute of the title set such as the datalength of the title set, a kind of characteristic used in the title set(e.g., Japanese and English) and the name of the title set.

In FIG. 31, the title table 112 xtt is illustrated in a form branchingoff at a right upper portion in the drawing. The title table 112 xtt hasthe plural fields for recording the plural title menu starting addressinformation #1, . . . , #n and the plural title contents startingaddress information #1, . . . , #n, in order from top to bottom in thedrawing, in a form making a pair depended on the number.

“Title menu starting address” shows the starting address of the titleinformation starting address including each title menu as the relativebyte number from the top of the title set. This byte number is countedfrom 0, for example. The title menu starting address “0” is assigned toa disc menu being the menu related to the entire disc. “Title contentsstarting address” shows the starting address of the title informationincluding each contents title as the relative byte number from the topof the title set. “Contents title” is the title showing the contents ofeach title. The byte number is counted from 0, for example. The titlecontents starting address “0” is assigned to a first play titleunconditionally reproduced at the beginning of the title reproduction,for example.

In FIG. 31, the playlist set table 112 xpt is illustrated in a formbranching off at a right lower portion in the drawing and has the pluralfields for recording the plural play(P)list set starting address #1, . .. , #n. “Playlist set starting address” shows the starting address ofeach playlist set as the relative byte number from the top of the titleset. The byte number is counted from 0, for example.

(1-2) Title Information:

Next, for the title information sets shown in FIG. 30, the titleinformation 200 will be explained with reference to FIG. 30 and FIG. 32.

In FIG. 30, the title information 200 is illustrated in a form branchingoff at a right middle portion in the drawing. In order from top tobottom in the drawing, the title information 200 has the field forrecording the information 200-1×showing the total number of the titleelements corresponding to the title general information 200-1 shown inFIG. 4, and further has the plural fields for recording the plural titleelements 200-2 (title element #1, . . . , #k) and the other information200-5.

“Total number of title elements” shows the total number of titleelements included in the title information.

In FIG. 32, each title element 200-2 is illustrated in a form branchingoff on the right side in the drawing. In order from top to bottom in thedrawing, the title element 200-2 has the pointer 200PT in which“playlist set number” is written, the total number of candidates and theplural fields for recording the P list identification information 200PNin which one or plural applicable play (P) list number(s) (i.e.,Plist#1, . . . ,#k) is (are) written. Moreover, each title element 200-2has the plural fields for recording the P list pre-command 200PR and theP list post command 200PS, and the plural fields for recording the nextinformation 200-6N indicating the title element to be reproduced next.The other information in the title element 200-2 is information relatedto each title element such as a kind of title, a sequential type and abranching type, for example.

“Pointer 200PT in which the playlist set number is written” is a pointershowing the ID (Identification) number of the playlist set. “Totalnumber of candidates” shows the total number of the playlists capable ofbeing the selective candidate of the title element in the playlist setdesignated by the pointer 200PT. “P list identification information200PN” shows the ID (Identification) number of one or plural playlist(s)capable of being the selective candidate. By providing the P listidentification information 200PN, the playlist being the selectivecandidate for the different title reproduction can be included in theone playlist set, and the one playlist set can be used in the differenttitle elements. Meanwhile, “P list pre-command 200PR”, “P list postcommand 200PS” and “next information 200-6N” are same as describedabove.

(1-3) Playlist Set:

Next, for the title information sets shown in FIG. 30, the playlist set126S will be explained with reference to FIG. 30, FIG. 33 to FIG. 36.

In FIG. 30, the playlist set 126S is illustrated in a form branching offat a right lower portion in the drawing. In order from top to bottom inthe drawing, the playlist set 126S has the field for recording theinformation 126-1 x including the total number of play(P) lists and theplural playlist (PL) presentations (PL presentations #1, . . . , #i) asthe information corresponding to the playlist set general information126-1 shown in FIG. 5. The playlist set 126S further has the pluralfields for recording the plural play(P) lists 126 (i.e., P lists #1, . .. , #i), the item definition table 126-3 and the other information126-4.

“Total number of playlists” shows the total number of playlists in theplaylist set. The PL presentations #1, . . . , #i are the attributeinformation corresponding to the P lists #1, . . . , # respectively, andthey correspond to the attribute information shown in FIG. 23.

As shown in FIG. 33, each PL presentation 126-1 xi is illustrated in aform branching off at a right upper portion in the drawing. In orderfrom top to bottom in the drawing, it has the plural fields forrecording the information indicating a video codec, a video resolution,a video aspect ratio, a video frame rate and an audio channelassignment.

“Video codec” shows the kind of the video codec which was used at thetime of recording the video information for to the playlist set and isused at the time of reproduction thereof. “Video resolution” shows thevideo resolution used at the time of recording of the video informationfor the playlist corresponding to the main pass (i.e., the video streamsupplying the main video) in the playlist sets. “Video aspect ratio”shows the video aspect ratio used at the time of the recording of thevideo information for the playlist corresponding to the main pass in theplaylist sets. “Video frame rate” shows the video frame rate used at thetime of the recording of the video information for the playlistcorresponding to the main pass in the play list sets. “Audio channelassignment” shows the assignment of the audio channel used at the timeof recording of the sound information for the playlist corresponding tothe main pass in the playlist sets.

In FIG. 33, each playlist 126 is illustrated in a form branching off ata right middle portion in the drawing. In order from top to bottom inthe drawing, it has the plural fields for recording the informationindicating the data length of the playlist 126, the playlist header, theplural playlist elements 126-2 (i.e., P list elements #1, . . . , #i).

“Length” of the playlist shows the length of the subsequent playlist bythe number of byte. This shows the length of the data including no“length” field itself. “Playlist header” shows the information such asthe total number of playlist elements included in the playlist, thereproduction time of the playlist and the name of the playlist.

Moreover, in FIG. 34, each playlist element 126-2 is illustrated in aform branching off on the right side in the drawing. In order from topto bottom in the drawing, it has the plural fields for recording thepointer 126PT showing the item number for the master play(P) item, thetotal number of sub-passes, the plural pieces of sub-pass information126-2sub (i.e., sub-pass information #1, . . . , #k), the nextinformation 126-6N, the pre-command 126PR for the play(P) item, the postcommand 126PS for the play(P) item and the other information 126-6.

“Pointer 126PT”, “pre-command 126PR” and “post command 126PS” are sameas described above. In addition, “total number of sub-passes” shows thetotal number of sub-passes existing in the playlist element. “Nextinformation 126-6N” shows the playlist element to be reproduced next.

Moreover, in FIG. 35, each sub-pass information 126-2sub is illustratedin a form heading for the middle portion to branch off on the right sidein the drawing. In order from top to bottom in the drawing, it has theplural fields for recording the sub-pass type, the total number orsub-play(P) items and the plural sub-play (P) item information 126-subPT(i.e., the sub-P item information #1, . . . , #k).

“Sub-pass type” shows what display is performed by the sub-pass, such asvarious kinds of menus. “Total number of sub P item” shows the totalnumber of sub-play items in the sub-pass.

Each sub-play (P) item information 126-subPT is illustrated in a formbranching off from the middle portion to the right end in the drawing.In order from top to bottom in the drawing, it has the plural fields forrecording the sub-play(P) item number and the start PTS of the masterplay(P) item.

“Sub P item number” shows the ID (Identification) number of the playitem in the sub-pass. “Start PTS (Presentation Time Stamp) of the masterplay item” shows the reproduction time of the sub-item on thereproduction time axis of the master play item.

On the other hand, in FIG. 33, the item definition table 126-3 isillustrated in a form branching off at a right lower portion in thedrawing. In order from top to bottom in the drawing, it has the pluralfields for recording the total number of play(P) items, the pluralplay(P) items 204 (i.e., P items #1, . . . , #n).

“Total number of playitems” shows the total number of items 204 in theitem definition table.

In FIG. 36, each item 204 is illustrated in a form heading for themiddle portion to branch off on the right upper side. In order from topto bottom in the drawing, it has the plural fields for recording theplay(P) item kind and the stream object play(P) item 204-stream.

“Play(P)item kind” shows a kind of the playitem. For example, the itemfor the stream object for the moving picture is prescribed as a code“00h”, and the item for the object for the still picture is prescribedas a code “10h”. Additionally, the item for the object for various kindsof menus is prescribed as a code “20h”.

Further, the stream object play(P) item 204-stream is illustrated in aform branching off from the middle portion to the right end in thedrawing. In order from top to bottom in the drawing, it has informationindicating the ES (Elementary Stream) index number, the IN time (INpoint) and the OUT time (OUT point) according to each playitem.

“ES index number” shows the ID (Identification) number and kind of theelementary stream to which the IN time and the OUT time are applied. Inaddition, “IN time (IN point)” and “OUT time (OUT point)” are same asdescribed above. For example, at the time base of 90 kHz, thereproduction time and end time of the item are written thereto.

In FIG. 36, the item definition table 126-3 may include the item204-still for the still picture object, instead of the item 204 for thestream object, i.e., the item 204 for the moving picture. In this case,the item 204-still has the information indicating the kind of the playitem and the still picture object play(P) item.

Each data amount in the above-mentioned title information set may befixed byte or variable byte. Moreover, each of the fields may have astructure capable of adding the necessary number of tables.

In this embodiment, particularly, the sub-play(P)item information126-subPT shown in FIG. 35 designates the sub-item for reproducing“browseable slide show” explained with reference to FIG. 20 to FIG. 28.As shown in FIG. 36, the sub-item corresponds to the item 204 shown by“master P item number” in the playlist element 126-2. As a result, thereproduction of the tile based on the video stream is executed as a mainpass in accordance with the stream object playitem 204-stream (see theright end of FIG. 36) designating the item 204. With this execution, thereproduction of “browseable slide show” is executed as the sub-pass inaccordance with the sub-item information 126-subP™ (see the right end ofFIG. 35) designating the sub-item.

(2) Object Information File

Next, with a specific example, the detailed description will be given ofthe object information file 130 in a case that the object data for“browseable slide show” is multiplexed with the video stream serving asthe main video as the sub-picture stream to be recorded, with referenceto FIG. 37. FIG. 37 schematically shows one specific example of the datastructure in the AU (Associate Unit) table 131 and the associated ES(Elementary Stream) map table 134 formed in the object information file130 (see FIG. 3).

As shown in FIG. 37, in this embodiment, in the object information file130, the object information table is stored. The object informationtable is constructed by the AU table 131 and the ES map table 134 shownat the upper portion and the lower portion in the drawing, respectively.

At the upper portion in FIG. 37, the AU table 131 may have the structurecapable of adding the necessary number of tables for each field. Forexample, if the four AUs exist, the AU table 131 may have a structurecapable of increasing the number of the fields up to four.

“AU table general information” in which the number of AUs and thepointer to each AU are written and “other information” are stored indifferent fields in the AU table 131.

In the AU table 131, as the AU information 132I indicating the ES tableindex #m (ES_table Index #m) in each PU #m corresponding to each AU #n,the index number (Index number= . . . ) of the correspondent ES maptable 134 is written. “AU” is the unit corresponding to “program” in theTV broadcasting as described above, for example. (Particularly, in thecase of “multi vision type” broadcasting, “AU” is the unit of the set ofthe plural switchable “visions”,) In the AU, one or more PU(s) being thereproduction unit(s) is(are) included. In addition, “PU” is a set ofmutually switchable elementary streams included in each AU as describedabove, and the ES table index # corresponding to each PU is specified bythe PU information 302I. For example, when multi-view contents isconstructed by the AU, the plural PUs are stored in the AU, and thepointers to the plural elementary stream packets ID indicating thepacket constructing the contents of each view are stored in each PU.This indicates the index number in the ES map table 134, which will bedescribed later.

At the lower portion of FIG. 37, in the ES map table 134, the ES maptable general information, the plural indexes #m (m=1, 2, . . . ) andthe other information are stored in different fields.

In “ES map table general information”, the size of the ES map table andthe total number of indexes are written.

“Index #m” includes the elementary stream packet ID (ES_PID) of theentire elementary streams used for the reproduction, the correspondentindex number and the address information of the elementary stream,respectively.

For example, in this embodiment, when the elementary stream is the videostream of the MPEG2 as described above, as the address information,i.e., the ES address information 134 d, only the TS packet number at thetop of the I picture and the correspondent display time are written inthe ES map table 134, and the amount of data is cut down. Meanwhile, asfor the ES address information 134 d of the sub-picture stream, theindex number information 134 e of the elementary stream of the SP dataon which the SP control information operates is written, and the amountof data is further cut down.

By this structure, the elementary stream packet ID (ES_PID) of theactual elementary stream can be obtained from the index number of the ESmap 134 designated from the AU table 131. In addition, since the addressinformation of the elementary stream corresponding to the elementarystream packet ID can be also obtained at the same time, the reproductionof the object data becomes possible based on the information.

According to the above-mentioned data structure of the optical disc 100,if a new title is added to the optical disc 100, the necessaryinformation can be easily added, which is useful. Conversely, even if anedition is performed and certain information becomes unnecessary, theinformation does not have to be referred to. Namely, the informationdoes not actually have to be deleted from the table, which is useful.

In FIG. 37, the ES_PID which is not referred from the AU table 131 atthe upper portion is written by the index of the ES map table 134 at thelower portion. However, as for the ES_PID which is not referred to, thedescription in this manner is unnecessary. However, if the ES_PID whichis not referred to is written and the wide use ES map table 134 isproduced, the reconstruction of the ES map table advantageously becomesunnecessary in a case of reediting the contents, i.e., in a case ofretrying authoring. The description will be given of the reproductionorder of various kinds of files at the time of reproduction of theoptical disc 100 having the data structure according to the specificexample explained with reference to FIG. 30 to FIG. 37.

First, from the title information set shown in FIG. 30, the disc header112 x is reproduced. As a part of it, the title table 112 xtt shown inFIG. 31 is reproduced, and the title menu starting address or the titlecontents starting address is obtained.

Next, according to the obtained address information, the reproduction ofthe title information 200 shown in FIG. 30 is started. Morespecifically, the title element 200-2 shown in FIG. 32 is reproduced andthe playlist set number is obtained. Moreover, the pointer 200PT to theplaylists #1 to #k is obtained. Since the playlist 126 is structurallydesignated by the pointer 200PT, the plural playlists in the playlistset specified before by the reproduction of the title element 200-2 canbe used between the plural titles.

Next, the playlist set table 112 xpt shown in FIG. 31 is reproduced, andthe playlist set starting address is obtained. Based on it, thereproduction of the playlist set 126S shown in FIG. 33 is started, andthe PL presentation 126-1 xi is first reproduced.

Next, the PL presentation 126-1 xi being an example of the demandfunction information and the reproduction function (i.e., the videoperformance and the audio performance) of the information reproductionsystem reproducing the optical disc 100 are compared. Thereby, anoptimum playlist 126 is chosen from the playlist set 126S shown in FIG.33.

Next, the chosen playlist 126 is reproduced. Specifically, the playlistelement 126-2 shown in FIG. 34 is reproduced. At this time, thepre-command 126PR is first executed, and then the master P item numbershown in FIG. 35 is obtained. Subsequently, the item definition tableshown in FIG. 36 is referred to. Thereby, the item 204 is reproduced.The reproduction of the item 204 is actually performed by thereproduction of the corresponding TS object in accordance with the ESindex number, the IN time and the OUT time obtained by the reproductionof the stream object P item 204-stream (see FIG. 37). Afterward, thepost command 126PS shown in FIG. 34 is executed, and the designation ofthe playlist element to be reproduced next is further performed inaccordance with the next information 126-6N. The reproduction issimilarly repeatedly performed.

FIG. 38 shows a specific example of the object information table for thebrowseable slide show. In this example, as for the still picture, thedisplay time information such as the MPEG is not added to the objectitself. Namely, each still picture is displayed in the order of theindex number in the PU. “Object type” in the AU table indicates a use ofeach object. In this example, the objects #1 and #3 show the stillpictures used for the browseable slide show, and the object #2 shows theaudio data used for the browseable slide show.

The item information and the sub-item information further include theinformation indicating the object number in the object information file130. The corresponding object is specified by the corresponding objectnumber and AU number, and it is reproduced by the above-mentionedreproduction sequence (see FIG. 27 and FIG. 28).

As explained with reference to FIG. 1 to FIG. 38, according to thisembodiment, it becomes possible to efficiently perform the display ofthe menu screen such as a small window display and a semitransparentsuperimposing display with the title reproduction continuous byreproducing the menu by the correspondent sub-item and selectivelyexecuting the display output of the reproduced menu during thereproduction and display output of the title by the item, for example.

Incidentally, in the aforementioned embodiment, the explanation is madeon the optical disc 100 as an example of the information record mediumand the recorder or player of the optical disc 100 as an example of theinformation record reproduction apparatus. Nevertheless, the presentinvention is not limited to the optical disc and the player or recorderthereof, but is applicable to various record media and the recorders orplayers thereof, supporting other high density recording or hightransfer rate.

For example, as shown in FIG. 39, the default sub-P item information126MI having the sub-P item number and the start PTS of the master Pitem may be included in the play(P) list. When no sub-pass informationis in each P list element, the default sub P item information 126MI maybe commonly used.

The present invention is not limited to the above-described embodiments,and various changes may be made, if desired, without departing from theessence or spirit of the invention which can be read from the claims andthe entire specification. An information record medium, an apparatus forand a method of recording the information, an apparatus for and a methodof reproducing the information, an apparatus for and a method ofrecording and reproducing the information, a computer program forcontrolling the record or the reproduction, and a data structureincluding a control signal, all of which involves such changes, are alsointended to be within the technical scope of the present invention.

For example, according to the above-mentioned embodiment, the stillpicture information includes the plural still pictures However, thestill picture information may include at least one still picture.

INDUSTRIAL APPLICABILITY

An information record medium, an apparatus for and a method of recordingthe information, an apparatus for and a method of reproducing theinformation, an apparatus for and a method of recording and reproducingthe information, a computer program for controlling the record or thereproduction, and a data structure including a control signal, all ofwhich are according to the present invention, can be applied to ahigh-density optical disc for consumer or industrial use, such as a DVD,on which various information, such as the video information, the audioinformation and the sub-picture information, can be recorded at highdensity and further can be applied to a DVD player, a DVD recorder, andthe like. Moreover, they can be applied to an information record medium,an information record reproduction apparatus, or the like, which aremounted on or can be connected to various computer equipment forconsumer or industrial use, for example.

1. An information record medium, comprising: recorded object data, theobject data being a multiplex of a first stream including still pictureinformation and a second stream including audio information by a unit ofpacket; and recorded reproduction control information, the reproductioncontrol information comprising: i) first reproduction sequenceinformation which designates a reproduction sequence of the first streamby a first unit and which includes time information indicating areproduction start timing of the first unit; ii) reproduction timeinformation which indicates whether each still picture of the stillpicture information of the first stream is a finite value or an infinitevalue, and which indicates a reproduction time of the still picturewhose reproduction time is the finite value; iii) first type informationwhich indicates a type of the first unit; iv) first storage positioninformation which indicates a storage position of the object datadesignated by the first unit; v) second reproduction sequenceinformation which designates a reproduction sequence of the secondstream, and which includes audio repeat information indicating whetheror not the audio information of the second stream is to be repeatedlyreproduced; vi) second type information which indicates a type of thesecond stream; and vii) second storage position information whichindicates a storage position of the object data designated by the secondreproduction sequence information, wherein the object data and thereproduction control information are recorded separately at differentareas.
 2. The information record medium according to claim 1, whereinthe audio information has a beginning and an end; and wherein repeatreproduction of the audio information according to the audio repeatinformation is the repeated reproduction of same audio informationthrough the end of the audio information consecutively followed by thefurther reproduction of the audio information from the beginning of theaudio information so that the repeated reproduction of the same audioinformation is continued during the reproduction of the still pictureinformation resulting in a total reproduction time of the repeatreproduction of the audio information that is equal to a totalreproduction time of the still picture information.
 3. An informationrecording apparatus comprising: a first recording unit which recordsobject data formed by multiplexing a first stream including stillpicture information and a second stream including audio information by aunit of packet; and a second recording unit which records reproductioncontrol information comprising: first reproduction sequence informationwhich designates reproduction sequence of the first stream by a firstunit and which includes time information indicating a reproduction starttiming of the first unit; reproduction time information which indicateswhether each still picture of the still picture information of the firststream is a finite value or an infinite value, and which indicates areproduction time of the still picture whose reproduction time is thefinite value; first type information which indicates a type of the firstunit; first storage position information which indicates a storageposition of the object data designated by the first unit; secondreproduction sequence information which designates reproduction sequenceof the second stream, and which includes audio repeat informationindicating whether or not the audio information of the second stream isto be repeatedly reproduced; second type information which indicates atype of the second stream; and second storage position information whichindicates a storage position of the object data designated by the secondreproduction sequence information, wherein the first recording unit andthe second recording unit record the object data and the reproductioncontrol information separately at different areas.
 4. An informationrecording method comprising: a first recording process which recordsobject data formed by multiplexing a first stream including stillpicture information and a second stream including audio information by aunit of packet; and a second recording process which recordsreproduction control information comprising: first reproduction sequenceinformation which designates a reproduction sequence of the first streamby a first unit and which includes time information indicating areproduction start timing of the first unit; reproduction timeinformation which indicates whether each still picture of the stillpicture information of the first stream is a finite value or an infinitevalue, and which indicates a reproduction time of the still picturewhose reproduction time is the finite value; first type informationwhich indicates a type of the first unit; first storage positioninformation which indicates a storage position of the object datadesignated by the first unit; second reproduction sequence informationwhich designates reproduction sequence of the second stream, and whichincludes audio repeat information indicating whether or not the audioinformation of the second stream is to be repeatedly reproduced; secondtype information which indicates a type of the second stream; and secondstorage position information which indicates a storage position of theobject data designated by the second reproduction sequence information,wherein the first recording process and the second recording processrecord the object data and the reproduction control informationseparately at different areas.
 5. An information reproduction apparatusfor reproducing an information record medium recording object data andreproduction control information, the object data being formed bymultiplexing a first stream including still picture information and asecond stream including audio information by a unit of packet, theobject data and the reproduction control information being recordedseparately at different areas, the reproduction control informationcomprising: first reproduction sequence information which designates areproduction sequence of the first stream by a first unit and whichincludes time information indicating a reproduction start timing of thefirst unit; reproduction time information which indicates whether eachstill picture of the still picture information of the first stream is afinite value or an infinite value, and which indicates a reproductiontime of the still picture whose reproduction time is the finite value;first type information which indicates a type of the first unit; firststorage position information which indicates a storage position of theobject data designated by the first unit; second reproduction sequenceinformation which designates reproduction sequence of the second stream,and which includes audio repeat information indicating whether or notthe audio information of the second stream is to be repeatedlyreproduced; second type information which indicates a type of the secondstream; and second storage position information which indicates astorage position of the object data designated by the secondreproduction sequence information, the information reproductionapparatus comprising: a reading unit which reads the still pictureinformation, the audio information and the reproduction controlinformation from the information record medium; a still picturereproduction unit which reproduces the still picture information; and anaudio reproduction unit which reproduces the audio informationsimultaneously with reproduction of the still picture information inaccordance with the audio repeat information in the reproduction controlinformation.
 6. An information reproduction method for reproducing aninformation record medium recording object data and reproduction controlinformation, the object data being formed by multiplexing a first streamincluding still picture information and a second stream including audioinformation by a unit of packet, the object data and the reproductioncontrol information being recorded separately at different areas, thereproduction control information comprising: first reproduction sequenceinformation which designates a reproduction sequence of the first streamby a first unit and which includes time information indicating areproduction start timing of the first unit; reproduction timeinformation which indicates whether each still picture of the stillpicture information of the first stream is a finite value or an infinitevalue, and which indicates a reproduction time of the still picturewhose reproduction time is the finite value; first type informationwhich indicates a type of the first unit; first storage positioninformation which indicates a storage position of the object datadesignated by the first unit; second reproduction sequence informationwhich designates reproduction sequence of the second stream, and whichincludes audio repeat information indicating whether or not the audioinformation of the second stream is to be repeatedly reproduced; secondtype information which indicates a type of the second stream; and secondstorage position information which indicates a storage position of theobject data designated by the second reproduction sequence information,the information reproduction method comprising: a reading process whichreads the still picture information, the audio information and thereproduction control information from the information record medium; astill picture reproduction process which reproduces the still pictureinformation; and an audio reproduction process which reproduces theaudio information simultaneously with reproduction of the still pictureinformation in accordance with the audio repeat information in thereproduction control information.